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California, Illinois, and New York; reading gain score data from 
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Executive Summary 



Questions of how to assess adult literacy skills and the effectiveness of programs that aim 
to improve these skills are pervasive in adult education. This report addresses the needs of 
policymakers, program operators, teachers and researchers for information about methods 
that have been and are being used to assess adult literacy skills and programs. It also provides 
a resource for staff development that provides concrete illustrations of the importance of 
theory in determining the types of assessments that are developed and how various 
assessments can suggest different approaches to adult literacy development in and out of 
programs. 

This report, Adult Literacy In the United States: A Compendium of Quantitative Data and 
Interpretive Comments, includes extensive quantitative data on the assessment of adult 
literacy skills and programs ranging from World War I (1917) up to the present. The 
Compendium presents over 100 pages of graphics and literacy test items with interpretive 
comments that show the relevance of the data to ( 1) theoretical and conceptual issues in adulr. 
literacy; (2) workforce and workplace literacy; and (3) family literacy and the intergenerationd 
transfer of literacy. Implications for practice, policy, and research are presented throughout 
the report. 

The Compendium contributes to the activities of the National Institute for Literacy (NIFL) 
that are aimed at assisting the Nation to achieve goal number 5 of the National Education 
Goals and Goals 2000. Specifically, it addresses NIFL objectives to \l) better understand 
the assessment of adult literacy skills and the development of promising adult literacy 
instructional techniques, (2) establish a national database with respect to assessment tools 
for adult literacy programs, and (3) disseminate information to adult literacy practitioners, 
policymakers, and researchers. 

Overview of the Compendium 

The Compendium provides in three parts a concise and comprehensive reference source for 
adult literacy policymakers, practitioners and researchers on adult literacy assessments 
spanning a 75 year period. The major divisions of the Compendium include the following. 

Introduction to the Compendium. The Introduction provides a theoretical framework for 
interpreting the assessments described in the remainder of the report. The framework 
includes the following concepts from the cognitive sciences. 

( 1 ) The concept of a human cognitive system that emphasizes the role of knowledge in 
literacy along with the information processes involved in oral and written language 
use and reasoning with graphic tools of thought (flow charts, tables, etc.). 

(2) A developmental model of literacy showing how childhood processes develop 
into adult literacy ability. 
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(3) An information processing view of learning that emphasizes the active, construc- 
tive nature of cognitive development (including literacy) in social contexts . 

Part I: Assessing Adult Literacy Skills. Part I of the Compendium summarizes major military 
and civilian assessments of adult "intelligence," "aptitude," and "literacy." Numerous items 
are presented, many with commentary to clarify the item's meaning or to relate the item to 
other information. Assessments reviewed include the following. 

(1) The World War I Army Alpha test for literates and the Army Beta test for illiter- 
ates. 

(2) The World War II Army General Classification Test (AGCT). 

(3) The Armed Forces Qualification Test (AFQT) from the 1950' s up to the present 

(4) The Armed Services Vocational Aptitude Battery (ASVAB) including sub-tests 
in job-relatedareas such as automotive, shop, electronics, and mechanical infor- 
mation. 

(5) The 1937 studies of adult reading in Chicago by Guy Buswell using "functional, 
real world" materialslike those in the current National Adult Literacy Survey. 

(6) The 1971 NAEP assessment of adults with* special analysis of some 21 items 
that were per formed by 9,13, 17 year olds & adults. 

(7) The 1971 Harris surveys of adults' skills in completing various government 
forms. 

(8) The Adult Performance Literacy (APL) study of the early 1970's with data for 
the various items in the survey. 

(9) The 1986 young adult literacy survey (YALS) that developed the Prose, Docu- 
ment and Quantitative scales used in the 1993 National Adult Literacy Survey 
(NALS). 

(10) The 1993 National Adult Literacy Survey (NALS). 

Part II: Special Topics. This part of the Compendium summarizes studies of the assessment 
of listening and reading skills of adults, the intergenerational transfer of literacy from adults 
to their children, and relationships of literacy to occupations and to job performance. 

Part m: Testing of Adult Literacy Development in Education Programs. Data on changes in 
literacy skills in adult literacy programs in California, Illinois, and New York are presented. 
Reading gain score data are also presented for a variety of adult literacy programs from 
around the nation. Finally, rare data are presented on the longitudinal changes in adults' 
literacy skills as a function of participation in literacy programs for up to three years. 
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MAJOR FINDINGS 



Major findings are summarized for each part of the Compendium. 
Introduction 

In developing the theoretical framework from the cognitive sciences, a new interpretation of 
tests of "verbal intelligence," "verbal aptitude," and "literacy" is provided. In this new 
conception, all these types of tests are considered as tools for attempting to characterize a 
person's cognitive system for some purpose, such as job selection, placement in educational 
programs, or making policy decisions about the need for various services. Using this 
reinterpretation of these various types of cognitive assessments to review research studies 
and numerous assessment surveys, several major findings have been formulated. 

The Nature of Highly Literate Adults. Extensive research is cited that indicates that highly 
literate adults perform well on numerous tests of "intelligence," "aptitude," or "literacy." 
High correlations among these types of tests mean that people are being rank-ordered in a 
similar manner across numerous tests. The tests contain different vocabulary items, paragraph 
comprehension, and information processing demands. Therefore, the only way that highly 
literate people can perform well on all such tests is to possess an extensive knowledge base 
in long term memory and an efficient information processing system in working memory, as 
outlined in the human cognitive system model. 

The Importance of Vast Bodies of Knowledge. An implication of the foregoing for adult 
literacy practice is that, if adults are to achieve high levels of literacy, they must develop an 
extensive knowledge base (including both content knowledge and strategy knowledge as 
outlined in the developmental model of literacy) and very efficient information processing 
skills for reading and writing. Because the development of large bodies of knowledge and 
highly efficient processing skills requires extensive time for practice and wide-ranging 
reading, adult programs must either retain adults for long periods of time, or stimulate adults 
to engage in extensive reading and writing outside of programs, or do both. However, present 
adult literacy programs do not focus on developing any particular bodies of knowledge, 
except to a limited degree in GED preparation. 

Where time is limited, literacy programs may develop a fairly extensive body of knowledge, 
in a restricted domain, in a fairly brief period. Knowledge involved in prose, document, and 
quantitative literacy as assessed on the National Adult Literacy Survey (NALS), job-related 
literacy as in workplace literacy programs, or parenting-related literacy as in family literacy 
programs may be fairly rapidly acquired. However, there is reason to question whether this 
new knowledge will be retained unless it is actually used either in additional education and 
training programs or in day-to-day activities. 



The Importance of Practice in Reading. Several assessments of adult literacy skills and 
practices (e.g., reading books* magazines* newspapers) show that y ~ars of education, amount 
of practice, and increased skill .go together. Highly literate adults have more education and 
engage in more reading practices. An important implication for adult literacy programs is that 
efforts should be made to get adults to engage in larger amounts of reading in various types 
of literacy practices both inside and outside of programs. Extensive free-reading practice 
may be as important as direct instruction in producing higher levels of literacy. 



Part I: Assessing Adult Literacy Skills 

Similarity of Literacy Items Across Time. To a large extent, the tasks found on literacy 
assessments operationally define what various experts, advisors, teachers of adults, and test- 
developers think about the nature of literacy. Despite the considerable debates about the 
suitability of different types of literacy tasks that are assessed in national surveys, such as 
whether to use multiple-choice or constructed response items, "academic" or "real world" 
items, etc., when the actual items are examined that various advisory boards have approved 
over several decades, there appears to be a remarkable similarity among items over the last 
75 years. 

Similarity of Findings Across Time. Beginning with the World War I assessments in 1917, 
a number of trends have remained salient across time. 

( 1 ) Higher educated adults perform better than less educated adults. 

(2) Younger adults perform better than older adults. 

(3) Adults in western, eastern, and northern states perform better than those in 
southern states. 

(4) Whites perform better than African-Americans or non-native language speakers. 

(5) Adults in professional, managerial, and clerical occupations perform better than 
adults in laborer, agricultural, and other relatively unskilled occupations. 

(6) Higher income groups perform better than groups with lower incomes or on 
welfare. 

(7) Higher educated adults engage in a greater amount of reading of books, maga- 
zines, and news papers. 

An implication of these findings for policymakers and researchers is that any number of 
literacy assessments can be used to rank order the adult population with regard to verbal 
"intelligence," "aptitude," or "literacy" and the same general trends can be followed. This 
suggests that, if the concern is simply to identify adults who are high, medium or low in 
literacy skills, consideration should be given to research for identifying the most cost- 
effective methods of assessing adult literacy skills. For instance, the very simple vocabulary 
and paragraph comprehension tests of the Armed Forces Qualification Test ( AFQT) produce 
about the same distribution of adults in five literacy levels as does the more extensive (and 
expensive) National Adult Literacy Survey (NALS). 
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An implicatior for practitioners is that if programs aim to produce highly literate adults, they 
should produce graduates who can score well on any of these "verbal" or "literacy" 
assessments. 



Part II: Special Topics 
Listening and Reading 

Less Skilled Readers are Less Skilled Listeners. A limited number of studies were reviewed 
that used group-administered or individually-administered tests to compare reading to 
listening skills. These studies indicate that, as a general trend, adults who score low on 
reading tests also score low on listening tests. In most cases, they do not perform any better 
by listening than by reading, except at the very lowest reading levels (e.g., below the second 
grade level). This line of research is important because the "gap" between a person' s reading 
level and his or her "reading potential" identified by an orally-administered "intelligence" 
test is used to identify adults who are "learning disabled" or "different." The "intelligence" 
test is very similar to a "listening" test. Hence, studies of listening and reading are important 
in the diagnosis of adult learning disabilities. 

Knowledge and Listening. An implication of the finding that less literate adults may also be 
underdeveloped in listening vocabulary and comprehension is that less literate adults possess 
a more limited knowledge base than more highly literate adults. Therefore, programs that 
aim to make large increases in adults* reading skills by a brief program of decoding will find 
that this does not tend to happen. Even though high levels of reading decoding might be 
developed (though not in a brief period of time), if the person does not possess a high amount 
of knowledge expressible in language, then considerable time will be required in extensive 
wide-ranging reading to acquire the vocabulary and conceptual knowledge that is needed, 
along with efficient decoding skills to achieve at high levels on literacy assessments. 

The Intergenerational Transfer of Literacy 

Parents' Education Level is Related to their Adult Children's Literacy Skills. Data are 
presented showing that parent's, and especially mother's education level is related to the 
literacy skills of their children at ages 9, 13, 1 7, and in adulthood. This is true forboth military 
and civilian assessments and for whites, blacks, and Hispanics. However, for the minority 
groups studied, the higher educated parents do not transfer higher levels of skills to the same 
extent that whites do. For instance, white mothers who are college graduates have adult 
children who score on the average at the 80th percentile on the Armed Forces Qualification 
Test (AFQT) while African-American mothers who are college graduates have adult 
children who score on the average below the 50th percentile. Research is needed to 
determine whether adult basic education or family literacy programs can improve the 
amount of intergenerational transfer of literacy from parents to children over that which 
occurs naturally in the situations that produced the data summarized in Part II of the 
Compendium. 
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Literacy, Oc national Status, and Job Performance 

Literacy is Related to Occupational Status . Findings from the World War I data on "intel- 
ligence" to the 1 993 data on "literacy" in the National Adult Literacy Survey (N ALS) indicate 
that cognitive ability is related to the occupational status that adults achieve. Data from the 
Young Adult Literacy Survey of 1986 on the literacy rkills of adults and the literacy skills 
of members of various occupational groups show that about 63 percent of whites, 39 percent 
of Hispanics but only 20 percent of blacks have literacy scores on prose, document, and 
quantitative literacy equal to or greater than the average score of Clerical workers. Black 
college graduates have average literacy scores below the average for Clerical workers. An 
implication of these findings is that if jobs are changing to demand even higher levels of 
literacy, as some have argued, then African-Americans may find it increasingly difficult to 
compete for and enter into higher-skilled, higher-paying occupations. There is clearly a need 
to better understand the implications of the findings from the various adult literacy surveys, 
the demands of workplaces for literacy skills, and the success of higher education in preparing 
all graduates to meet these demands. 

Literacy is Related to Job Knowledge and Job Task Performance. Studies by the military 
relating reading ability to paper-and-pencil job knowledge tests and "hands-on" job-sample 
tests are summarized in Part II of the Compendium. Findings indicate that reading is related 
to higher levels of performance on these measures of job proficiency, though the correlations 
are not large. One study indicates that if workers both have higher reading skills and use them, 
they may increase their productivity on job sample tests by as much as 1 5 to 20 percent. No 
research outside the military services was found that explores relationships among literacy 
skills and various measures of job proficiency. The data reviewed in the Compendium are 
now almost a quarter century old. 

Part III: Testing of Adult Literacy Development in Education Programs 

Judging the effectiveness of educational programs designed to improve the literacy levels of 
adults is becoming increasingly important in the current accountability and assessment 
climate. Part HI of the Compendium focuses on the assessment of literacy skill development 
in a wide variety of programs across the nation, including California's federally-funded 32 1 
programs, community college-based programs in Illinois, programs in New York City and 
a variety of programs in correctional facilities, the Job Corps, job training centers, family 
literacy programs and others. 

Pre- and Post -Test Scores and Gains in Adult Literacy Programs. Viewing across all the 
programs, the data indicate that adult literacy programs are uniformly successful in increasing 
adult literacy skills by 0.5 to 1 .5 "years" in anywhere from 1 to over 200 hours of instruction. 
This observed gain is only minimally influenced by the entering level of adult's skills or the 
hours of instruction between pre- and post-tests. 
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Longitudinal Data Show Little Gain After the First Post-Test Only two data bases were 
found that presented repeated testing of adults who stayed in literacy programs for a year or 
more. In both data sets, an initial year or so of gain was observed, and then repeated 
assessments indicated that the rate of gain slowed and became almost level. Students in New 
York City who were in programs for up to three years gained 2.0 years of skill, from the 1 .5 
grade level to the 3.5 grade level. A year and a half of that gain was made between the pre- 
test and the first post-test given a year later. 

It should be noted that all test scores presented were average scores for programs. Averages 
conceal the large differences that may occur among the individuals in the programs. Many 
of the programs may have included adult students who developed quite a bit of skill. 
Similarly, however, there may have been many students who made little or no gain. 

A general finding is that typical program evaluation reports do not provide much information 
about variance in scores; standard deviations are typically not reported nor are the distributions 
of scores on pre- and post-tests. Importantly, no studies or reports were found in which 
concern was expressed about the level of gain reported and what might be done to increase 
adults' learning as measured by standardized tests during the program. More likely, when 
low test score gains were reported, the standardized tests were criticized as invalid indicators 
of what was actually learned in the program. Generally, no alternative indicators of growth 
in achievement were reported. 

Hopefully, the extensive review of literacy assessments presented in this Compendium, with 
the major findings outlined above, will lead to new approaches both to improving the extent 
of growth that adults achieve both in and out of adult literacy programs, and to new, cost- 
effective measures that can inform policymakers about general literacy trends among adults. 
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Adult Literacy In 

The United States 

A Compendium Of Quantitative Data 



This Compendium presents a large body of quanti- 
tative data obtained in numerous studies since the 
U.S. Army introduced the mass testing of adult 
cognitive skills in World War L Concepts from 
educational research and the field of cognitive sci- 
ence are used to interpret these assessments. The 
data and interpretations provide new insights into 
the nature of adult literacy and its development. 
These insights form the basis for suggestions about 
how to produce more effective approaches to adult 
literacy assessment and education. 

The Compendium and its interpretive comments 
should be of use in staff development programs for 
adult educators. It can serve as a resource for univer- 
sity courses in psychological testing and for organi- 
zations engaged in the development of adult literacy 
assessments. It can also be used directly by adult 
literacy teachers, their students, and interested oth- 
ers as informal checks of how their own literacy 
skills compare to the skills of others across the last 
seventy-five years. This form of self-checking using 
test items from different time periods can also reveal 
the extent to which literacy assessments reflect the 
cultural context of the time. 

A Cognitive Science Framework for 
Interpreting the Assessments of Adult Literacy 

In all of the literacy assessments reviewed in the 
Compendium, a similar process was followed by 
those administering the tests. First, instructions were 
given to groups or individuals about the tests they 
were to take. Then, some form of test was adminis- 



tered that (1) presented some information display, 
either spoken or in a graphic format, such as written 
language, (2) posed some mental reasoning task to 
be performed on the information displayed, (3) re- 
quired some responses to be made by the examinees 
that were (4) used to arrive at a score for each person 
in the group, that (5) was used to make inferences 
about people's cognitive abilities that could be used 
to (6) makes inferences about how well people will 
perform in some other context beyond the test situ- 
ation, such as in a training program, on a job, or in a 
community activity. 

Figure 1 presents a simple conception of a human 
cognitive system at work in a test environment like 
that just described. The person possesses a long term 
memory that contains the person's body of knowl- 
edge, including among other things, language 
knowledge and knowledge about how to do things 
(procedural knowledge), including grammar and 
reasoning processes. To a large extent, all of the 
assessments reviewed herein can be considered as 
attempts to understand what knowledge the person 
possesses and/or what tasks the person can accom- 
plish by drawing on the knowledge and reasoning 
processes in the cognitive system. 

What Figure 1 makes distinct are the differences 
between the knowledge stored in long term memory 
and the language, reasoning and other information 
processing processes that are used in working 
memory to represent and think about knowledge. 
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Figure 1 



Model of a human cognitive system used to interpret studies on the assessment 
and educational development of literacy and other cognitive abilities. 



Long Term 
Memory 



Short Term or 
(^Working Memory 




Simple Model of Human Cognitive System 



Long Term Memory contains the 
knowledge base with language and 
various information processing 
knowledge. 

When thinking is taking place, 
information processing occurs in 
Short Term or Working Memory. 
The information processing skills 
operate on information in the 
knowledge base and information 
picked-up from "knowledge bases 
outside the head/' such as books, 
speech, and non-language sources. 

Reading can be improved by 
increasing knowledge in the base or 
by improving or adding to 
information processing ability, or 



Extensive research by the armed services (surveyed 
in Sticht , 1 992) indicates that three major factors that 
render people able to score high on either intelli- 
gence, aptitude or literacy tests are ( 1 ) the possession 
of vast bodies of knowledge in long term memory, 
(2) the ability to process information in working 
memory in a very efficient manner, and (3) the 
efficiency with which these two system components 
can interact. 

A general finding from numerous assessments of 
adult cognitive abilities is that, with a broad range of 
abilities in the test population, there are high corre- 
lations among performance on intelligence, aptitude 
or literacy tests. In one study by the Department of 
Defense, correlations between the military's verbal 
aptitude test scores and scores on any one of five 
different standardized tests of reading were in the .8 
to .9 range, about as higt^as they could get given the 
psychometric properties'bf the tests (Waters et. al., 
1988, p. 46). 



These high correlations indicate that on any one of 
the tests taken at random, highly literate persons will 
achieve in the upper range of scores, moderately 
literate persons will score in the mid-range, and less 
literate persons will score in the lower range of 
scores. 

An implication of these findings is that, if adult 
literacy education programs are to be judged suc- 
cessful in producing graduates who are considered 
highly literate, these graduates should be able to take 
any number of standardized tests of either intelli- 
gence, aptitude or literacy and perform well on them, 
certainly above the 60th percentile. Graduates con- 
sidered moderately literate should be able to score 
in the mid-range on any one of these types of 
assessments, i.e., from around the 40th to the 60th 
percentiles. Adults who leave programs unable to 
reach the mid- or high-levels of literacy will tend to 
perform poorly on any one of these assessments ot 
cognitive abilities. 
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A Developmental Perspective 

In addition to drawing on the model of the human 
cognitive system, we interpret findings in the Com- 
pendium from time to time following a simple devel- 
opmental model of the major processes, knowledge 
bases and sequences of development that people go 
through in becoming literate. 

The developmental model is based on the under- 
standing that, living in social groups with shared 
cultural experiences, we form normative expecta- 
tions for what people at different ages can and cannot 
be expected to do. In a typical case, one will not use 
a form of addressing a person 's cognitive system that 
the person is not expected to be able to process. For 
instance, one does not typically hand a written note 
to a two-year-old that asks for personal information 
such as a name. But one would ask for the child's 
name using oral language. Here the normative as- 
sumption is that, typically, a two-year-old can talk 
and comprehend simple oral language but generally 
cannot read. 

Similarly, one does not ask an infant for information 
because it is assumed that typically infants cannot 
comprehend and speak oral language well enough to 
communicate. But facial expressions, gestures, 
laughing sounds, etc., might be used in a communi- 
cative manner to play with the infant and receive 
responses such as laughing, smiling, hand and arm 
movements, etc. 

In short, in our literate society, we have expectations 
for how infants, two-year-olds, six-year-olds, ado- 
lescents, and adults develop their cognitive systems 
over time. We have an implicit developmental model 
of literacy that guides our use of communication 
methods in different circumstances. 

In several research projects, the implicit develop- 
mental model of literacy was made explicit and 
included a large number of concepts from cognitive 
psychology. This model of "the typical case of a 
child growing up in our literate society" is presented 
schematically in Figure 2 (see Sticht, Beck, Hauke, 



Kleiman & James, 1974 for an extended discussion 
of an earlier version of the developmental model of 
literacy and a review of literature related to hypoth- 
eses derived from the model; Sticht , 1992 reviews 
testing data interpreted in terms of the developmen- 
tal model). 

Before addressing the details of the model, several 
orienting comments regarding the figure are in or- 
der. First the figure is meant to portray a develop- 
mental sequence when examined from left to right. 
The sequence begins with the newborn infant, and 
goes through stage 4 in which literacy skills are 
functional. The broad arrowhead on the far right is 
meant to imply continued development over the 
lifespan. The development of literacy, language, 
and knowledge is a lifetime activity. 

Examining Figure 2 from top to bottom, the top 
series of boxes is meant to represent the environment 
in which the person exists. This is the environment 
"outside the head." This external environment makes 
available information displays that the person can 
explore and transform into internal representations 
of the external information. These internal represen- 
tations are developed by the processes in the second 
series of boxes labeled, on the far left, Information 
Processes in Working Memory, These processes go 
on "inside the head," and merge information picked 
up from the external information displays with infor- 
mation picked up from the third series of boxes, 
labeled on the far left as Long Term Memory, Thus, 
the processes in the working memory are used to 
pick-up and merge information from outside the 
brain with information in long term memory inside 
the brain to construct an internal representation of 
the world as currently experienced, including the 
meaning of symbolic information when this is a 
major domain of information being extracted from 
the external world at a given time. 

At the top of Figure 2, there are references to four 
"stages." In the present case, the concept of Mage 
1" does not refer to automatic and immutable cogni- 
tive "unfoldings." Rather, the term refers to what 
would typically be observed at different times it one 
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Figure 2 
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studies children growing up in our literate society. 
For instance, stage 1 refers to the newborn infant 
who is considered to be innately endowed with the 
Basic Adaptive Processes involved in sensory/per- 
ceptual processes such as hearing and seeing, etc., 
motor movement, and cognition, including the pro- 
cesses needed to acquire information, mentally ma- 
nipulate it, store it in memory, form knowledge 
structures out of it, retrieve and represent the infor- 
mation in various ways. In stage 1, these processes 
are assumed to work more or less automatically 
without conscious control, hence an observer would 
note that the infant seems "captured** by stimuli, 
rather than selective in observing information in the 
world. 



Stage 2 represents the emergence of conscious con- 
trol over information pick-up and manipulation. 
This active process of attending to information dis- 
tinguishes listening from hearing, and looking from 
seeing, as information pick-up processes. Listening 
and looking build internal representations that may 
be called images. Images may also be constructed 
from data stored in long term memory. These 
internal imaging processes are frequently assessed 
in aptitude tests as "spatial perception** or "mechani- 
cal comprehension** in which it is necessary to 
mentally visualize and rotate cog-and-gear assembles 
to determine what effects this movement might have 
on some other gear. 
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Stage 2 also introduces the concept of active or 
working memory, which is defined by the occur- 
rence of consciously controlled information pro- 
cessing activities- Working memory is a limited 
memory that can be easily overloaded (e.g., attend- 
ing to two or three things at once is difficult — if not 
impossible). Many of the information processing 
activities the person acquires will be techniques to 
overcome active memory limits (e.g., repeating in- 
formation to oneself keeps the information in active 
working memory until it can be applied). The "stage" 
aspect in cognitive development shows itself by the 
ability of the infant to attend to information selec- 
tively. This is a cognitive capability which, once 
developed, is a permanent feature of cognition that 
distinguishes the stage 2 child from the stage 1 child. 

Stage 3 represents the development of language 
processes out of earlier processes and knowledge 
stored in long-term memory. In developing oral 
language, the listening process is used in attending to 
spoken language to learn the words and grammar of 
language. Thus, listening plus languaging, occurs 
simultaneously. This joint occurrence is given the 
special name of auding. On the production side, the 
joint occurrence of uttering (making sounds through 
the mouth) with the production of word forms from 
the language pool, and stringing the word forms 
together to make sentences using the rules of gram- 
mar, produces the special process called speaking. 
Auding and speaking comprise the oral language 
information reception and production skills. Speak- 
ing is used to represent information that the person 
has in his or her mind "outside the head" and in the 
acoustic medium, while auding is used to pick-up 
and transform speech information displays into 
knowledge in the mind of the listener. To an observer, 
the stage 3 child can respond to and produce oral 
language, at least to some minimal degree. Again, as 
with conscious attending, once oral language has 
begun to emerge, the cognitive system is permanently 
modified (barring physiological trauma of some 
sort), and the person is no longer capable of exclu- 
sively prelinguistic modes of thought. 



In transitioning to stage 4, the information process- 
ing skills of looking and marking are used to learn a 
representational system which, in many respects, 
represents the spoken language, in a different me- 
dium light, and in a more or less permanent graphic 
display: the written language. Looking at written 
language and transforming the written language into 
meaning is called reading. Writing is the special use 
of marking skills to produce graphic language (and 
other symbols and symbol systems). 

In the typical case, people develop a fair amount of 
competence in oral language before they are ex- 
posed to formal instruction in reading in elementary 
grades (though informal learning of literacy may 
begin in the home and community in literate cul- 
tures). Written language skills build upon the earlier 
developed oral language skiUs and add new vocabu- 
lary and concepts, as well as special knowledge 
about how to represent information in the graphic 
medium, to the person's knowledge base. In turn, 
learning new vocabulary and conventions of lan- 
guage through reading and writing enlarges the 
person's oral language abilities. The large arrow at 
the far right in Figure 2 is meant to represent the 
notion that the development of oral and written 
language ability may continue indefinitely as the 
person studies and develops new knowledge do- 
mains. 

A major component of Figure 2 is the person's long 
term memory or "knowledge base" discussed above 
as a part of the human cognitive system. The long term 
memory contains all the knowledge developed by 
the person in interaction with the environment. Much 
of the knowledge acquired by the person will not be 
understood in consciousness (for example, the rules 
of grammar). Rather, it will be unconsciously used 
to accomplish tasks such as developing language 
competence and comprehending the events of the 
world. In addition to the general world knowledge 
and processes that are in the mind, though not 
necessarily accessible to conscious understanding 
without considerable analysis, the memory also con- 
tains the language knowledge (words and grammar > 
that can be used to represent information that arises 
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from experience in the world (e.g., bodies of knowl- 
edge about machines, parts of the body, houses, 
neighborhoods — sometimes called "schema" or 
"mental models") and from didactic instruction, as 
in training programs (Sticht, 1992). 

The model indicates that the development of the 
oracy skills of speaking and auding are built upon the 
prior development of prelinguistic knowledge 
through information processing activities. It is im- 
portant that it be understood that this early, 
prelinguistic cognitive content, or knowledge, will 
form the foundation for the acquisition of new 
knowledge over the person's lifetime, including that 
knowledge known as "literacy." 

Much of this knowledge will remain personal, and 
will not be explicitly represented in language for 
communication to others. Nonetheless, such per- 
sonal, tacit knowledge, which includes perceptual 
learnings and general knowledge of "how the world 
works," will be absolutely necessary for learning to 
comprehend the spoken, and later the written, lan- 
guage. This reflects the fact that language is selec- 
tive in the features and concepts chosen to be repre- 
sented. We may think of language as producing a 
verbal figure, which can be comprehended only in 
terms of its relationship to a nonlinguistic concep- 
tual ground of "world knowledge." A simple illus- 
tration of the role of "world knowledge" in literacy 
training is seen in the recommendation to give stu- 
dents experience with objects and events in the 
world through field trips, demonstrations, movies, 
etc M before they read about them* This approach 
provides an experiential base or a "world knowl- 
edge" which will permit a deeper comprehension of 
the words and concepts the students read, and greater 
"access" to prior knowledge via perceptual learning. 

A final aspect of the model is that it recognizes that, 
on the one hand, the literacy skills of reading and 
writing utilize the same knowledge base that is used 
in auding and speaking, plus the special decoding 
and encoding skills of reading and writing. On the 
other hand, the very nature of the written language 
display — characterized by being more or less 



permanent, being arrayed in space, and utilizing the 
features of light (color, contrast) — makes possible 
(i.e., affords) the development of skills and knowl- 
edge entirely different from those involved in oral 
language. 

The model incorporates the role of prelinguistic 
looking and marking abilities as contributors to later 
utilization of the visual display of written language 
in conjunction with graphic marks such as lines, 
white space, and color to develop graphic tools for 
thinking and problem solving like matrices, flow 
charts, color coded graphs, and so forth. These tools 
combine with written language and non-language 
graphic symbols, such as arrowheads and geometric 
figures, to produce analytical products beyond those 
obtainable through the fleeting, temporal, oral lan- 
guage. 

A point to be emphasized is that much of the ac- 
quisition of literacy is not simply learning to read; 
that is, it is not just learning a graphic language 
system that can be substituted for the oral language 
system. Rather, a large part of learning to be literate, 
and perhaps the most important part for acquiring 
higher levels of literacy, is learning how to perform 
the many tasks made possible by the unique charac- 
teristics of printed displays — their permanence, 
spatiality , and use of light, and using that knowledge 
to develop large amounts of new knowledge (see the 
discussion of the Army's Beta test in Part I to learn 
how "literacy," considered here as reasoning while 
engaged in visual information processing in work- 
ing memory, was used by military psychologists to 
assess "intelligence" without having the person ac- 
cess much information in long term memory). 

The foregoing, and Figure 2 briefly summarize the 
structure of the developmental model of literacy and 
emphasize: 

• An architecture for a human cognitive system that 
contains a long term memory (knowledge base) and 
a working memory. The mind draws upon certain 
procedural knowledge, including language, that is in 
the long term memory and uses that procedural 
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knowledge for processing information taken both 
from the long term memory and from the external 
world. The latter serves as a sort of "external 
memory" that displays information to be picked up 
by the sensory systems and internal processing skills 
and merged with prior knowledge in the process 
generally called "learning." 

•The development of additional knowledge, includ- 
ing that knowledge known as literacy, as extensions 
to or transformations of earlier knowledge. In par- 
ticular, the developmental mode! emphasizes the 
development of oral language from earlier, 
prelinguistic knowledge, and literacy as an amalgam 
of prelinguistic (stages 1 and 2) and linguistic (stage 
3) knowledge. Literacy includes the procedural 
knowledge (processes) used in guiding information 
pick-up and processing by the visual, auditory, and 
other perceptual systems, and declarative knowl- 
edge generally representable in oral and graphic 
symbol systems (this includes content knowledge 
such as mathematics, geography, etc. when learned). 

Learning as Information Processing 

In addition to the models of the human cognitive 
system and the development of literacy, the concep- 
tual framework to be used in interpreting literacy 
assessments in the Compendium includes a concep- 
tion of learning as the outcome of constructive, 
information processing activities. 

The information processing approach to learning 
emphasizes internal mental processes involved in 
* learning. It views the person as an active, adaptive 
organism busily ordering and arranging an internal- 
ized representation of life space. According to this 
view, learning is the result of an active, constructive 
process on the part of the learner working with 
information from the internal or external environ- 
ments. This differs from a strict behavioristic con- 
ception in which learning is the result of some fixed, 
automatic process of association among stimuli, 
responses, and their consequences. 

The information processing approach to learning 



emphasizes internal strategies for dealing with infor- 
mation, such as the use of imagery or mnemonic 
(contextualizing) devices to aid in learning a list of 
words. Thus, the information processing position 
would lead us to seek different internal processing 
strategies even though certain stimulus-response 
sequences may be the same. For instance, interest 
would focus not only on whether or not a problem is 
solved, but also upon how it was solved. It is thus 
analytic, stressing the detailed analysis of tasks in 
regard to the knowledge and mental operations in- 
volved "inside the head" between the occurrence of 
a stimulus and a subsequent response (i.e., "cogni- 
tive task analysis"). 

A most important aspect of the information process- 
ing approach to learning is the emphasis upon the 
active, constructive nature of the person as he or she 
draws upon prior knowledge to function in the cur- 
rent learning context. This suggests that cognitive 
assessment and instructional programs should offer 
an environment for and a stimulus to active informa- 
tion seeking, mental representation and re-represen- 
tation to bring a larger share of prior knowledge to 
bear on the learning task, and external communica- 
tion to check, confirm and further develop learning. 

In summary, the theoretical framework used herein 
to interpret research on literacy includes the concept 
of a human cognitive system comprised of a long 
term memory with its knowledge base and a short 
term working memory that operates through infor- 
mation processing activities on the information in 
the long term memory and the external world of 
information. Cognition includes both knowledge 
and the processes for developing knowledge. 

The long term memory develops over the life of the 
person as the latter undergoes the transitions from 
pre-language, to oral language, to written language- 
based information processing. As the key develop- 
mental information processing outcome in our liter 
ate society, the person comes to acquire thp informa 
tion processing skills involved in a widkvariety of 
cognitive acts involving graphic symbol systems for 
language processing and for performing various 
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cognitive tasks involved in problem solving and 
reasoning. 

This developmental progression of the person oc- 
curs as the result of active, constructive information 
processing activities that represent and re-represent 
knowledge to forge new learning from old. The new 
knowledge adds to the knowledge base in the long 
term memory and is activated in various contexts 
through constructive processes that are sensitive to 
the different contexts. This means, for instance, that 
even though one possesses certain knowledge and 
skills, they may not be accessed if the context in 
which the person is immersed does not activate 
them. 

In the Compendium, this cognitive science frame- 
work of a human cognitive system, developmental 
model of literacy, and an information processing 
approach to learning, is used to reinterpret and 
summarize the large body of data concerned with the 
assessment of literacy over the last 75 years. 

What Makes People Highly Literate? 

If, as indicated earlier, the long term memory must 
possess vast bodies of knowledge and if high levels 
of information processing skills in working memory 
are needed to be highly literate, then how do the 
highly literate acquire this knowledge and skill? 

Quantitative data from assessments of adult literacy 
in 1937, 1973 , and 1986 (see pages 43, 63, and 99 in 
this Compendium) suggest what might be called the 
"triple helix" of literacy development: skill, prac- 
tice, and education. A salient finding across the last 
half century is that people with higher levels of 
education have higher levels of literacy skill and 
they engage in higher levels of literacy practices, i.e., 
they read books, magazines and newpapers more 
frequently than do the less educated and less skilled. 

The data on the intergenerational transfer of literacy 
in Pan II shows that better educated parents tend to 
have children who achieve better in school. A con- 
siderable body of evidence indicates that preschool 



children from homes that have higher income levels 
and where parents have higher education levels 
frequently acquire considerable oral language vo- 
cabulary and literacy knowledge before they enter 
school (see chapters by Mason & Kerr and Diana 
Slaughter-Defoe in Sticht, Beeler, & McDonald, 
1992). These children have typically engaged in 
some forms of literacy practices, such as scribbling 
with pencils and crayons as "pre-writing", and per- 
haps they have even learned to print their names and 
other words.They may have been read to and devel- 
oped knowedge of the "sound of printed language." 
They may have learned the alphabet and even how to 
read simple stories. 

As children who have engaged in pre-school literacy 
practices and developed pre-school literacy skill 
enter school, they tend to do better in school, and the 
school directs their reading into areas that they might 
not engage in otherwise. As children and other 
people read more and more widely, they develop 
higher levels of information processing skills in- 
volved in recognizing printed words and other fea- 
tures of the written language, and they learn the 
meanings of more and more words, i.e., they develop 
more extensive bodies of knowledge. This in turn 
helps them do well in school, so they pursue further 
education. This guides them to engage in additional 
reading practices, and, in turn this helps them de- 
velop more efficient reading skills and helps them 
acquire more knowledge. 

This scenario suggests that while higher levels of 
skill, education and practice typically go together, it 
is possible to develop high levels of literacy through 
the engagement in high levels of practice, without 
attending formal education for very long. This may 
have been illustrated in the World War I assessment 
of "intelligence." The fact that officers with very 
few years of education scored quite high on the 
Alpha test of "intelligence" for literates, was inter- 
preted by the military psychologists of the time to 
indicate that the test measured "innate intelligence/* 
But it seems likely that what made it possible for the 
unschooled officers to score fairly high on the Alpha 
was the knowledge and information processing skill 
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they had acquired, perhaps by doing considerable 
independent reading (see pages 19 - 24 for a discus- 
sion of the Alpha and Beta tests and examples of the 
items on each of these tests). 

The Importance of Practice for 
Literacy Development 

There is a growing body of evidence to suggest that 
children's development of literacy skill across the 
school years results to a large extent from the reading 
they do outside of school (Anderson, Wilson, & 
Fielding, 1988; Stanovich, 1993). Anderson, et. al. 
reported a wide range of amount of reading of books, 
magazines, comics, and mail for fifth grade students 
in a year. Children at the 30th percentile of amount 
of out-of-school text reading read about 251,000 
words a year. While children at the 70th percentile of 
amount of out-of-school reading read some 1 , 1 68,000 
words a year. Amount of reading was significantly 
related to reading achievement. 

Children in the 3rd through 6th grades with reading 
skills at the 25th percentile have been found to lose 
over the summer almost half of the skill they gain 
during the school year. While those at the 75th 
percentile actually gain skill over the summer (Bar- 
bara Heynes, as reported in Berlin & Sum, 1988, p. 
37, Figure 10). 

Among adults, higher levels of engagement in read- 
ing practices has been found to be associated with 
higher levels of education, vocabulary, and cultural 
knowledge, such as knowledge of names of famous 
authors, magazines, and other people (West, 
Stanovich, & Mitchell, 1993). 

The combined evidence suggests that practice in 
reading, and especially the reading of books, is a 
potent contributor to the development of vast bodies 
of knowledge in long term memory and efficiency in 
word recognition and other aspects of the processing 
of language and graphic displays of information in 
working memory. 

The low achievement gains in the pre- and post-test 



scores of adult literacy programs found in Part III of 
the Compendium may reflect low levels of practice 
in reading by students outside of the literacy pro- 
grams (or, for that matter, inside the program. We 
have very little information on "time on task'* in 
adult literacy classrooms or learning centers). To 
date there is very little information about the extent 
to which adults increase their out-of-c lass reading as 
a consequence of participating in adult literacy pro- 
grams. The data above would seem to suggest that if 
such programs do not lead to fairly large increases in 
out-of-class reading, then the adult learners are not 
likely to develop the vast bodies of knowledge and 
efficient information processing skills needed to 
achieve high levels of literacy. 

Loss of Literacy Ability 

Some evidence exists to suggest that adult students 
who leave literacy programs may not only fail to 
develop additional literacy skills if they do not 
engage in further literacy practice, but also that they 
may actually, and fairly rapidly, lose new found 
skills if they are not practiced after the program 
(Sticht, 1975, p. 118). In military research, U. S. 
Army literacy students who received job-related 
reading training and then went on to job technical 
training were retested about eight weeks after leav- 
ing the literacy program. It was found that at the end 
of the six week literacy program the students had 
gained 2.4 reading grade levels (RGL) of skill in job- 
related reading. Eight weeks later, after completing 
job technical training, that gain dropped to 1 .9 RGL, 
for a retention rate of 80 percent. However, while 
gain in general literacy was about 1 .0 RGL at the end 
of the job-related literacy program, eight weeks later 
that gain had dropped to 4 months (or 0.4 RGL), for 
a retention rate of only 40 percent of what had been 
gained in general literacy. 

The foregoing suggests that although the amount of 
reading practice may have dropped when the stu- 
dents left literacy training and entered job technical 
training, they nonetheless continued to practice 
reading job-related materials. This may have helped 
them maintain their gain in job-related literacy. 
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However, since it is likely that they did not engage 
in as much reading practice as during the literacy 
program, this may have contributed to their loss of 
most of their gain in general literacy. 

Overview of the Compendium 

Part I: Assessing Adult Literacy Skills. 

Part I of the Compendium includes data from the 
testing of adults to determine the distribution of 
literacy skills in the population. Data are summa- 
rized for the period beginning with the Army's 
introduction of mass testing in 1917 during World 
War I and ending some seventy-five years later in the 
1992 assessment of adult literacy skills by the U.S. 
Department of Education. Data gathered in studies 
falling between these two points in time are also 
summarized. 

An interesting observation is that, despite consider* 
able debates about what sorts of tasks adults should 
be asked to perform to indicate their degree of 
literacy, whenever test specialists, educators and 
citizen groups have gotten together to decide how to 
assess adult literacy, the actual tasks that end up in 
assessment instruments look remarkably similar over 
the seventy-five year period. The major findings or 
trends in the data also look remarkably similar. 

Part I of the Compendium presents not only summa- 
ries of the data on adult literacy skills from this 
seventy-five year span of America's history . Addi- 
tionally, it presents numerous actual test items that 
were used in these studies to assess adult literacy 
skills. This permits readers to study these items to 
determine for themselves whether they appear to be 
suitable tasks that literate adults in the United States 
should be able to perform. Also, it permits adult 
literacy teachers to use these items with their stu- 
dents as informal indicators of literacy development 
in adult literacy programs. Indeed, both adult teach- 
ers and adult learners (and others) may find it inter- 
esting, and informative, to try their skill at doing 
tasks from across time, such as items from World 
Wars I (1917) and II (1940s), or the 1930's and 
1970's. 



Part II: Special Topics 

Part II of the Compendium examines three special 
topics in adult literacy assessment. First, relation- 
ships between listening and reading vocabulary and 
comprehension are examined. As suggested by the 
developmental model of literacy summarized above, 
children first develop a fair amount of knowledge 
and language ability before they formally begin 
learning reading and writing. Then, when they enter 
school, one of the primary aims of reading instruc- 
tion is to permit the child to access oral language 
encoded information via the printed display. 

When applied to adults, it is frequently believed that 
most less literate adults have followed the oral 
language development sequence in the developmen- 
tal model, and that they have acquired extensive oral 
language vocabularies and large amounts of concep- 
tual knowledge. It is thought that their literacy prob- 
lems are due mostly to their failure to learn how to 
"break the code" of written language. In this case, 
then, the simple and expeditious remedy for the 
problem is to provide a course of instruction in 
phonics and additional "decoding" skills. Then, once 
the adult has "broken the code" he or she will be able 
to bring a vast amount of vocabulary and oral lan- 
guage comprehension skills to bear on reading and 
understanding the written language. 

But the studies of listening and reading indicate that, 
despite some individual differences, as a trend, less 
literate adults tend to perform as poorly on tests of 
spoken language vocabulary and comprehension, 
when decoding written language is not part of the 
task, as they do on reading tests. Thus, brief tutoring 
on the decoding of written language will generally 
not suffice to bring the less literate to the higher 
levels of literacy being called for today. 

The second and third special topics deal with the 
intergenerational relationships of parent's educa- 
tion to the literacy skills of their children and with 
relationships of literacy to occupational status and 
job performance. 



Adult Literacy in the United State§ 

24 



■ 



Together, data from these three special topics indi- 
cate that the less literate adults are likely to be low in 
both oral and written language competence, and that 
their children tend not to achieve at the higher levels 
of literacy, even though they may complete educa- 
tion at the high school level or beyond. Further, as 
children grow up to become the less literate adults, 
the more likely they are to be found in the lower 
status occupations, and in many instances, the least 
literate will not perform job tasks as well as the more 
highly literate. 

One of the most disconcerting findings from the 
study of literacy and occupational status is that 
African-American college graduates performed 
Prose, Document and Quantitative literacy tasks 
at a level of skill below that of the typical clerical 
worker in the nation (page 137). Only 20 percent of 
African- Americans of any education level exceeded 
the average literacy levels of clerical workers (page 
136). This suggests serious occupational access 
problems for African- Americans in the future. 

Part III: Testing of Adult Literacy Development in 
Education Programs 

Part III of the Compendium moves from the assess- 
ment of the literacy skills of adults to the assessment 
of literacy skill development in adult literacy pro- 
grams. It presents a summary of the gains that adult 
literacy students have made in a wide variety of adult 
literacy programs across the nation. Numerous scores 
on standardized tests given at the beginnings of 
literacy programs are presented (called "prc-test" 
scores), along with scores made later on in the 
program or at the end of a program (called "post- 
test" scores). Limited data are presented for adults 
who were tested three or four times for up to three 
years. 

Generally, the data from these program assessments 
indicate that, on average, adults achieve about one- 
half to one-and-a-half "years'* of gain in a wide 
variety of programs. This gain is not influenced 
much by the entering level of skill of the students or 
the number of hours of instruction between pre- and 
post-tests. 



The data for students who were repeatedly post- 
y*ested three or more times in longitudinal studies 
/ indicate that little improvement occured after the 
first post-test. Why this is so is not knowable from 
the data presented. But , in pan, it may reflect a 
failure on the part of adult learners to engage in 
sufficient literacy practice, either in or out of pro- 
grams, to develop the extensive bodies of knowl- 
edge needed to move up the scale from lower to 
higher levels of literacy. 
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Military Origins Of Group Literacy Testing 



Data are presented for military assessments during 
World War I (1917-1919), the World War H era 
( 1940*s) , the Korean War era ( 1 950' s) , Vietnam era 
(1960*s) and the present, volunteer military service 
era ( 1970' s to 1990* s). Aside from the World War I 
tests of "intelligence," the military's tests of "apti- 
tude" have looked very similar for the last half 
century. There have always been vocabulary and 
mathematics tests of some sort in the military's 
aptitude tests. These have been used to indicate 
"verbal" and "quantitative" "aptitudes". At various 
times, there have been tests of spatial perception, 
tool recognition, and mechanical comprehension to 
detect special aptitudes. 

Overview of Military Tests 

For over 75 years, the armed forces have pursued a 
policy of assessing the mental ability of adults who 
are eligible for military service. In World War I, 
some 1.9 million men were tested on the Army 
Alpha test of intelligence for literates, and the Army 
Beta test of intelligence for illiterates and non- 
English speakers. 

Over the years, the mental ability tests used by the 
armed services have changed in content and in the 
definition of what they measure (see Table 1, p. 18), 
but they still represent attempts to assess the cogni- 
tive r kills of adults and to use that information to 
select people for military service and to assign them 
to work for which their "aptitudes" suit them. 

For the present report, four major periods in the 
history of military mental testing (Table 1) are 
considered. The first witnessed the introduction of 
mental testing during World War I. The second 
occurcd during World War II, when the first large- 
scale, operational use was made of mental tests for 
classifying recruits into job assignments. Separate 
tests were used by the Army and the Navy. The third 



major period occured in the 1950s, when the Armed 
Forces Qualification Test (AFQT) was specially 
designed andde vcloped to serve as a test for screening 
out low mental ability persons for all military ser- 
vices. The AFQT subtest scores were then com- 
bined with other tests, which differed for each ser- 
vice, to classify recruits into job assignments. The 
fourth period in military mental testing began in 
1976, during the All Volunteer Force, when the 
Armed Services Vocational Aptitude Battery 
( AS VAB) was introduced as the single test battery to 
be used by all military services for both screening 
and job classification. 

In Table 1 , only the four subtests of the AS VAB that 
make-up the AFQT that is used for screening for 
military service ait shown. Additionally, the AS VAB 
includes six other subtests that assess special knowl- 
edge or skill (Electronics Information; Mechanical 
Comprehension; Automotive and Shop Informa- 
tion; Coding Speed; General Science; Numerical 
Operations). The special knowledge subtests are 
combined with subtests from the AFQT to form 
ASVAB composites for classifying military appli- 
cants into job fields for which the military has 
determined their aptitudes suit them best. For in- 
stance, all four military services use an electronics 
composite made-up of Arithmetic Reasoning + 
General Science + Mathematics Knowledge + 
Electronics Information. The different services 
weight each subtest score differently in combining 
them into one composite score. 
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Table 1 


Tests Used by the Military for Assessment of Cognitive Skills 
From World War I to the Present 


Test 




Historical 
renoa usee 


Dates 

T let* A 

used 




Army Alpha 


WWI 


1918 


Oral directions, arithmetical 
problems, practical judgment 
synonyms-antonyms; disarranged 
analogies, information. 


Army Beta 


WWI 


1918 


Maze, cube analysis, O-series, 
digit symbol, number checking, 
pictorial completion, geometrical 
construction. 


Army 
General 

Classification Test 
(AGCT) 


wwn 


1941-1945 


Verbal, arithmetic computation, 
arithmetic reasoning, pattern 
analysis. 


Armed Forces 
Qualification Test 
(AFQT) 


Post- 

wwn 


1950-1952 


Word knowledge, arithmetic 
reasoning, spatial relationships. 






Korean War / 
Vietam War 


1953-1973 


Word knowledge, arithmetic 
reasoning, spatial perception, tool 
recognition. 


Armed Services 
Vocational 
Aptitude Battery 
(ASVAB-AFQT) 


All-Volunteer 
Force 


1976-1980 


Word knowledge, arithmetic 
reasoning, spatial relationships, 
mechanical comprehension. 








1980-1988 


Word knowledge, arithmetic 
reasoning, paragraph 
comprehension, numerical 
operations. 








1988-Present 


Word knowledge, arithmetic 
reasoning, paragraph 
comprehension, mathematics 
knowledge. 






Sources: Sticht. 1992, p. 13; Wigdor & Green, 199Up.50. 




Adult Literacy in the United State* 

29 



The Alpha and Beta Tests of World War I 



The Alpha Test 



The first mental tests designed to be used for mass, 
group testing were developed by psychologists for 
the U.S. Army in 1917-1918. The group tests were 
modeled after intelligence tests designed for indi- 
vidual use in one-on-one assessment. In developing 
the mental tests, the psychologists subscribed to the 
position that one could be quite intelligent, but 
illiterate or not proficient in the English language. 
Based on this reasoning, two major tests were devel- 
oped, the Army Alpha for literate groups, and the 
Army Beta for illiterates, low literates or non-English 
speaking (Yerkes, 1921). Both tests were based on 
the theoretical position that intelligence was an 
inherited trait, and the assumption was made that 
native intelligence was being assessed. Each test 
was made-up of a number of subtests (Figure 4, p. 
24), the contents of which differed depending on 
whether the test was for literates or illiterates, low 
literates or non-English speakers. 



Results 

Figure 3, p.23 shows the results of assessments with 
the Alpha and Beta tests for several special studies. 
These results show trends that have persisted up to 
the present time with national assessments. First, for 
both the Alpha and Beta tests, scores generally 
increase as years of education increase. Second, 
whites exceed blacks at all levels of education. 
Third, scores for Northern blacks exceeH those of 
Southern blacks. 

As mentioned earlier, the fact that poorly educated 
Officers performed well on the Alpha test was in- 
terpreted as indicating that the Alpha measured 
native intelligence. However, careful examination 
of the types of items that made-up each subtest 
suggests that literacy practices may have been higher 
among the Officers and this may have led to their 
improved performance on the Alpha test. 



As indicated in Figure 4, p. 24, the Alpha test battery 
for literates included a wide range of tests of 
knowledge and various cognitive skills. Using the 
simple model of the human cognitive system given 
in Figure 1, p. 4, the Alpha test can be reinterpreted 
not as a test of native intelligence but as a sampling 
of a wide variety of cognitive abilities by addressing 
the person's knowledge base by both oral language 
and written language. 

Test 1: Following Oral Directions, involves auding 
and comprehending simple or complex oral lan- 
guage directions and looking at and marking in the 
appropriate places on the answer sheet. To a large 
extent, this is a test of the ability to hold information 
in working memory and to combine earlier instruc- 
tions with later ones to determine the correct marking 
responses. 

The role of special bodies of knowledge in the 
performance of information processing activities is 
clearly illustrated in the remaining tests. 

Test 2: Arithmetical Problems, requires both the 
ability to read and comprehend the stated problem 
and the knowledge of arithmetic to perform the 
computations called for. Again, working memory is 
stressed by having to hold more than one phrase in it 
that is information bearing, then combining the 
phrases and performing the required computations. 
Mathematics knowledge is also required for Test 6. 

Test 3: PracticalJudgment, clearly requires reading 
and comprehending language. Additionally, how- 
ever, it requires knowledge of cuturally, normative 
expectations to make the "correct" choice. In terms 
of the developmental model of literacy, this means 
that the person's mind would have had to develop in 
an external context or environment in which ihe 
information needed to make the normative!* cor- 
rect" response would be presented in some tonn. 
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Test 4: Synonyms-Antonyms, requires specific vo- 
cabulary knowledge, in addition to the knowledge of 
"same" and "opposite." 

Test 5: Disarranged Sentences, requires semantic 
knowledge about flies as well as grammatical 
knowledge to rearrange the sentences, and informa- 
tion has to be held in working memory while rear- 
ranging the sentences. 

Test 6: Number Series Completion, emphasizes 
reasoning with number knowledge in working 
memory. 

Test 7: Analogies, clearly emphasizes culturally 
determined, semantic knowledge retrieval from the 
long term memory knowledge base, and also infor- 
mation processing in working memory to detect 
similarities among the different knowledge domains 
addressed by the analogies. 

Test 8: Information, is heavily loaded with cultural 
knowledge requirements. It is a probe of the person's 
knowledge base to discover the extent to which it 
includes both very familiar and less familiar de- 
clarative knowledge available in the United States' 
culture. 

Todetermine each person's intelligence level, scores 
for all eight subtests were combined into one total 
score. The correlation of Alpha total scores with 
Stanford-Binet mental age was .8 1 ( Yerkes, 1 92 1 , p. 
634, table 155). 

Based on a person's total Alpha score he was 
assigned a letter grade of A (superior intelligence), 
B, C+, C (average intelligence), C-, D, or D- (inferior 
intelligence). The letter grade became the person's 
mental category, and was taken as a general indicator 
of the person's native intelligence. This position was 
held even though there was a clear relationship of 
Alpha scores to years of schooling, in which much of 
the special knowledge, vocabulary and cultural 
knowledge would have been developed. Correlations 
of subtest scores with education were found in one 
special study to range from .5 1 for Test 3 (Practical 



Judgment) and years of schooling to .68 for Test 4 
and years of schooling, when low literates and non- 
English speaking were excluded. With low literates 
included (but not non-English speaking), these cor- 
relations ranged from .60 for Test 7 (Analogies) to 
.74 for Test 2 (Arithmetic) and years of schooling 
(Yerkes, 1921, p. 781, Table 326). Generally, the 
correlations of Alpha total test scores with education 
ranged from .65 if the low literates and non-English 
speaking were excluded to .75 when the latter were 
included (Yerkes, 1921, pp. 779-780). 

Rather than regarding the Alpha scores as reflecting 
the results of literacy practices and years of schooling, 
the test developers considered that the years of 
schooling completed reflected the results of the 
native intelligence measured by the Alpha tests 
(Yerkes, 1921,p.783). 



The Beta Test 

In determining who should take the Beta test, deci- 
sions were made frequently in terms of the number 
of years of education reported. Generally, those with 
fewer than four, five, or six years of education were 
sent to Beta testing. Additionally, men who were 
non-English speakers, or very poor in speaking 
English were sent for Beta testing. In some cases, 
men who tried the Alpha tests but were subsequently 
judged to be poor readers were readministered the 
Beta tests. The procedures were not uniform across 
the testing locations. 

As shown in Figure 4, p. 24, like the Alpha test, the 
Beta test battery for illiterates, low literates or non- 
English speakers also used a number of subtests. 
However, unlike the Alpha test in which instructions 
were given in oral and written language, the Beta 
subtest instructions were executed in pantomime by 
the testor and his aides.The examinees marked their 
responses on paper using pencils, but they were not 
required to use written language (though reading of 
number symbols was required in some subtests). As 
for the Alpha test, the Beta subtest scores were 
combined into one score, and that score was used to 
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assign letter grades indicating general intelligence. 

Though the attempt was to use the Beta test as an 
intelligence test comparable to the Alpha but freed of 
influences of literacy and the English language, 
examination of the subtests in (Figure 4) reveals 
major differences between the Alpha and Beta tests 
both in terms of the knowledge called for and the 
information processing skills involved in processing 
graphically presented information. 

As noted in the discussion of the developmental 
model of literacy (Figure 2, p. 6) there are two main 
aspects to literacy. On the one hand, literacy involves 
the use of graphics technology to produce a second 
signaling system for speech. That is, the written 
language is a graphical representation of the spoken 
language to a large degree. 

However, the second major aspect of literacy is the 
use of the elements of graphics technology - light, 
space, and permanence - to produce graphic devices 
to be used in information processing for problem 
solving, reasoning, and communicating. In the 
subtests of the Beta test, it is clear that literacy as the 
use of graphics technology for problem solving and 
reasoning is included in every subtest. 

Test 1: Maze, requires looking at the graphically 
represented maze while reasoning about the path to 
be taken. 

Test 2: Cube Analysis, requires counting cubes in the 
graphic representation and this combines the use of 
graphics information with knowledge of the language 
of arithmetic for counting 

Test 3: X-0 Series, requires reading graphic displays 
in left to right sequences while reasoning in working 
memory. 

Test 4: Digit Symbol, requires scanning the upper 
number and graphic symbols, holding them in 
working memory while scanning the lower numbers 
and then producing the appropriate mark to match 
the graphic symbol to the number. 



Test 5: Number Checking, is similar to Test 4 in 
requiring scanning and matching of graphic sym- 
bols, this time in numeric forms. 

Test 6: Picture Completion, clearly involves the 
scanning of graphic displays and the knowledge of 
the depicted objects to complete the picture. 

Test 7: Geometrical Construction, involves study- 
ing in working memory the graphics information on 
the left and mentally rearranging it to construct the 
figure on the right. 

From the foregoing analysis, it becomes clear that 
both the Alpha and Beta assessed cognitive skills 
with the concomitant use of literacy. That is, the 
ability to utilize graphic marks arrayed in various 
designs for information processing is common to 
both tests. The primary difference between the two 
tests is that the Alpha requires extensive reading 
defined in the developmental model as looking while 
languaging, while this is not required to any sig- 
nificant degree in the Beta test (though reading the 
letters and numbers of Tests 3, 4 and 5 permits some 
reading while languaging). 

In turn, languaging of sentences requires the retrieval 
of semantic information from the knowledge base 
stored in long term memory to be used in working 
memory for comprehending the information being 
picked-up from the graphic display in the text of the 
test. In the Beta test, on the other hand, most of the 
information processing could be done in working 
memory without the need to locate and retrieve 
semantically encoded knowledge from the long term 
memory. 

Intercorrelations among the Beta subtests ranged 
from a low of .41 for subtests 1 (Maze) and 5 
(Number Checking) to a high of .75 for subtests 5 
(Number Checking) and 4 (Digit Symbol). Perhaps 
the relatively high correlation of .75 for subtests 4 
and 5 reflects the fact that both make extensive use 
of number reading (Yerkes, 1921, p. 155, Table 
634). 
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The intercorrelations among the Alpha and Beta 
subtests that were obtained for the sample of men 
who first took the Alpha and then were referred for 
Beta testing ranged from a low of .36 for Beta test 2 
(Cube Analysis) with Alpha test 3 (Practical Judg- 
ment) to a high of .68 for Beta test 4 (Digit Symbol) 
with Alpha test 2 (Arithmetical Problems) (Yerkes, 
192 1, p. 634, Table 1 55). These are quite a bit lower 
than the correlations in the range of ,59 to .86 for 
intercorrelations among the Alpha tests given above. 

The correlation of Beta total scores with schooling 
ranged from .45 for a sample of over 1 1,000 native 
born men with education levels ranging from none to 
college, to .67 for a sample of 653 native-born 
draftees (Yerkes, 192i,p.781,tables327,328).For 
a sample of 5,803 foreign born the correlation of 
Beta total score with schooling was .50. In general, 
then, the correlations of Beta scores with years of 
schooling were lower than the correlations of Alpha 
scores and education (.75) when the full range of 
Alpha test takers (including those subsequently sent 
for Beta testing) was included. 



When the Alpha and Beta test total scores (excluding 
non-English speakers) were correlated with mental 
age scores on the Stanford-Binet individually ad- 
ministered intelligence test, the resulting coefficients 
were .81 and .73, respectively. Since the Stanford- 
Binet is essentially an auding test, in which the 
administrator speaks the questions and the given 
information, it is perhaps to be expected that the 
correlation between the heavily language-laden 
Alpha and Stanford-Binet tests would be greater 
than the very low language-based Beta test with the 
Stanford-Binet. For a sample of 653 recruits, the 
correlation of Stanford-Binet with years of school- 
ing was .65 (Yerkes, 1921, p. 782, Table 330). 
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Alpha / Beta Testing 



ARMY ALPHA 
Test for Literates 



Testl Following Oral Directions. 

"When I say 'go/ make a cross in the first circle 
and also a figure 1 in the third circle." 

0O0OOO 



Test 2 Arithmetical Problems 

Ex: If it takes 6 men 3 days to dig a 180 - foot 
drain, how many men are needed to dig it in half 
a day. Answer: (36) 



Test 3 Practical Judgment 

If a man made a million dollars, he ought to 
[ ] Pay off the national debt 
[x] Contribute to various worthy charities 
[ ] Give it all to some poor man 



Test 4 Synonyms - Antonyms 

Samples: good -bad same ■ o pposite 
little - small aaaifi - opposite 



Test 5 Disarranged Sentences 

leg flies one have only true - fiflafi 

Test 6 Number Series Completion 

2 3 5 8 12 17 23 3Q 

Test 7 Analogies 

gun - shoot: : knife - run cuts hat bird 

Test 8 Information 

The Wyandotte is a kind of: 
horse fowl cattle granite 



ARMY BETA 

Test for illiterates and foreign language 
speakers. 

Testl Maze. Credit for correct tracing of mazes. 



L7 



Test 2 Cube Analysis. Correct count of cubes. 



Test 3 X-0 Series. The series is to be carried 
out to the end of the line. 



XOXOXOXO 



X o x © 



Test 4 Digit Symbol. The appropriate symbol is 
to be written under each number. 

123456789 

3121321423529 

Test 5 Number Checking. Correct response 
indicated. 

699310 X . . 699310 

251004818 251004418 



Test 6 Picture Completion. 

Identify missing parts. 




(mouth missing) 



Test 7 Geometrical Construction. Construct a 
square (on right) out of figures on left. 

□ □ 

i i 1 — 1 
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The Army General Classification Test 
Of World Warn 

As the United States moved into World War n, the 
Army developed new mental tests to aid in the 
classification of recruits into jobs. At the time that 
the Army General Classification Test ( AGCT) was 
developed, psychologists in the military personnel 
research sections considered that 'Intelligence tests 
do not measure native mental capacity. They mea- 
sure actual performance on test questions. A test is a 
fairly valid measure of the native capacities which 
underlie the abilities tapped by its questions when 
every one tested has had equal opportunity and equal 
incentive to develop the abilities measured" (Zeidner 
& Drucker, 1983, p. 34). 

As interpreted by Zeidner & Drucker (1983), both 
long time members of the Army ' s personnel research 
activity, "the Army psychologists' World War II 
position was that the test scores represented nothing 
more than an index of measured abilities at the time 
the test was taken" (p. 35). 

The purpose of the AGCT was to serve as a measure 
of "general learning ability" that could be used to 
assign new recruits to jobs. 

The AGCT Test 

As indicated in Figure 5, p. 26, the Army General 
Classification Test (AGCT) included four subtests: 

The Vocabulary Test, required knowledge to select 
the correct response regarding the meanings of words 
in the person's long term memory. 

The Arithmetic Test, required knowledge of math- 
ematics as well as language-based knowledge to 
comprehend the words in the word problems.These 
types of problems are heavily dependent on efficiency 
of information processing in working memory, too. 

The Block-Counting Test, emphasized the use of 
literacy as graphics display processing and required 
visualization to imagine the presence of obscured 
blocks. 



Because the Army of World War II had to draw upon 
a primarily inexperienced young adult population 
and train recruits in a wide variety of technical and 
administrative fields, as well as mechanized combat 
jobs, the AGCT was validated as a classfication 
instrument by correlating scores on AGCT with 
grades in training courses. This seemed consistent 
with the interpretation of the AGCT as a measure of 
"general learning ability." Indeed, in content, the 
AGCT (Figure 5, p. 26) resembled measures of 
schooling, such as reading vocabulary ("verbal" 
ability) and arithmetic computation and word 
problem solving . Only a measure of "spatial analy- 
sis" was included that differed from school-based 
achievement tests. Given that the AGCT so much 
resembled a measure of past school learning, it is not 
surprising that it was found to correlate reasonably 
well with achievement in Army schools. 

As in World War I, scores on the subtests of the 
AGCT were combined into a total score, and recruits 
were assigned to "grades" based on their total scores. 
High scoring recruits, "rapid learners" were assigned 
to Army Grade I, next highest were Grade Us, then 
"average learners" in Grade HI, "below average" in 
Grade IV, and "slow learners" were assigned to 
Army Grade V. With the Selective Service Act of 
1948, an entire mental category, Army Grade V, 
comprised of some 8 percent of the young, white, 
male population, was excluded from service (Wool, 
1968, p.66). This was the first time that a statutory 
mental (literacy?) standard was set for military ser- 
vice. 
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Figure 5 



World Warn 
Army General Classification Test - AGCT 



Sample Vocabulary, Arithmetic, and Block-Counting 
Items from AGCT-la. 



31. 


AGE means most nearly 


(A) person 


(B) school 


(C) bread 


(D) time 


32. 


A STAVE is made of 


(A) thread 


(B) wood 


(C) jelly 


(D) grass 


33. 


To SQUABBLE is to 


(A) float 


(B) sing 


(C) dispute 


(D) speak 


34. 


ATHUDisa 


(A) nut 


(B) bolt 


(C) sound 


(D) light 


35. 


VIOLENT means most nearly 


(A) modem 


(B) dead 


(C) fierce 


(D) better 



36. Bill has 6 dollars, Jack has 8 dollars, and Henry has 4 dollars. How many dollars do they have 
altogether? _ 

(A) $16 (B) $14 (C) $17 (D) $18 

37. A man attended target practice 9 times. He scored 189 in all. What was his average score for 
each time? 

(A) 18 (B) 21 (O 24 (D) 27 

38. Six men went on a trip by automobile. The total expense was $13.44, which was shared 
equally. How much was each man's share of the total expense? 

(A) $2.24 (B) $2.56 (C) $2.92 (D) $3.24 

39. Men start work at 8:30 in the morning and quit at 12:00 noon. How many hours do the men 
work in the morning? 

(A) 21/2 (B) 3 (C) 3 1/2 (D) 4 

40 A camp has 186 men in three equal groups. How many men are in each group? 
(A) 62 (B) 93 (C) 33 (D) 59 



41. How many blocks? 




(A) 10 (B) 8 (C) 15 (D) 12 



42. How many blocks? 



44. How many blocks? 




(A) 18 (B) 24 (C) 19 (D) 27 



(A) 14 (B) 11 (C) 15 (D) 16 



45. How many blocks? 



(A) 9 (B) 10 (C) 11 (D) 12 



Source: Zeidner, J. & Diudcer, A. (1983, Much). Behavioral Science in the Army: A Corporate History of the Army Research Institute. Alexandria. V A: 
U.S. Army Reaeart* Institute for the Behaviond ar>d Social Science*, (p. 27). 
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Adult Literacy in the United States 



The Armed Forces Qualification Test (AFQT) 

In 1950, the Armed Forces Qualification Test (AFQT) 
was introduced as the single test that would be used 
to screen draftees and volunteers for entry into any 
of the armed services. With some changes in content 
(Table 1, p. 18), the AFQT has remained as the 
primary screening test for military service through 
the Korean and Vietnam Wars, and up to the present. 
As noted by Eitelberg, et. al (1984, p. 16). In 
developing the AFQT, care was taken to make 
certain that speed was not emphasized, so that slow 
workers would not be penalized, and that the verbal 
instructions were not so difficult as to obscure the 
test items themselves. In these ways, the test was 
designed to be especially useful for distinguishing 
among the least able. 



The 1950 AFQT Subtests (Figure 6> p. 28) 

The Vocabulary test, involves the retrieval of in- 
formation in the form of word meanings from the 
long term store of knowledge, and selecting the 
correct multiple choice alternative. 

The Arithmetic test, involves mathematics knowl- 
edge, semantic word meaning knowledge and the 
processing of information for problem solving in 
working memory. 

The Block-Counting test, involves visualizing 
missing information in graphic displays in working 
memory. 

The Spatial tesu involves reasoning in working 
memory while studying graphic displays of visual 
patterns. 

The 1953-1973 AFQT Subtests (Figure 7, p. 29) 

The AFQT for 1953-1973 retained Vocabulary, 
Mathematics, and Spatial subtests similar to those of 
the 1950 test. But the Clock-Counting test was 
dropped and a new Mechanical Ability test was 
added. 



The Tool Recognition test, required knowledge in 
long term memory of automotive and other shop 
tools for completion. 

Findings 

In practice, the scores on each of the AFQT subtests 
were combined into a single score and distributions 
were matched to the World War II distributions of 
examinee scores on the Army General Classification 
Test (AGCT). Then, as with the Army Alpha and 
Beta tests, and the AGCT, the total scores were 
grouped into "mental categories." 

In 1968, an article in American Education, published 
by the U. S. Department of Health, Education and 
Welfare, reported distributions by mental categories 
for Whites and Blacks. 

Table 2. Estimated Percentage of Draftees 
by Mental Group, by Race: FY 1966 . 



Mental Group 


Whites 


Blacks 


Total 


I 


7.6 


0.3 


6.7 


n 


32.1 


3.3 


28.8 


m 


34.6 


18.2 


32.8 


IV 


16.0 


38.2 


18.5 


V 


9.1 


37.1 


12.3 



Source: R. de Neuf ville & C. Comer ( 1 968). How good are our 
schools? Armed Forces Qualification Test Provides a Clue. 
American Education, p. 7. 

On June 30, 1951, Congress passed Public Law 51 
establishing the minimum acceptable standard for 
entry into military service at the 10th percentile, 
hence excluding persons in AFQT mental category 
V from service (Maier & Sims, 1986, A- 14). 

References 

Mark Eitelberg, Janice Laurence, Brian Waters, and 
Linda Perelman (1984). Screening for Service: Ap- 
titude and Education Criteria for Military Entry. 
Alexandria, VA: Human Resources Research Or- 
ganization (p. 16). 

Milton Maier and W. Sims ( 1986, July). TheASVAB 
Score Scales: 1980 and World War //. CNR 1 16. 



ierJc 



03 The Armed Force* Qualification Te&t 19S3 A 1973 

38 



27 



Figure 6 



Armed Forces Qualification Test - AFQT - 1950 



Sample Vocabulary, Arithmetic, Block-Counting, 
and Spatial Items from AFQT-la. 



30. The tie was not a ppropriate . 

(A) attractive 

(B) expensive 

(C) necessary 

(D) suitable 

31. He was bewildered . 
(A) angry 

(3) anxious 

(C) confused 

(D) disgusted 

32. Food supplies were abundant on the 
island. 

(A) available 

(B) limited 

(C) plentiful 

(D) scarce 



37. If a boat carries 24 times as much as a 
plane, how many planes are needed to 
carry the goods from 6 such boats? 

(A) 204 

(B) 144 

(C) 6 

(D) 4 

38. If railroad fares are increased 20%, how 
much more will you pay on a $15.00 
ticket? 

(A) $3.00 

(B) $2.00 

(C) $1.50 

(D) $ .75 







Source: Zeidner. J. & Drucker, A. ( 1983. March). Behftvural Science in the Anny: A Corporate History of the Army Research Institute. Alexandria, VA: 
U.S. Army Research Institute for the Behavioral and Social Sciences (p. 51 ). 
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Armed Forces Qualification Test - 1953-1973 



Vocabulary, Mathematics., Mechanical Ability, 
Special Relationship Subtests of the AFQT for 1953-73. 



Vocabulary 

There will be be variable winds. 

A) shifting 

B) chilling 

C) steady 

D) mild 



He is a man of great vigor. 

A) wickedness 

B) strength 

C) reputation 

D) wisdom 



Mathematics 



If 12 men are needed to run 4 
machines how many men are 
needed to run 20 machines 



During one year the fruit crop 
was 500 bushels. The next year 
the crop increased 102 percent. 
How many bushels were produced 
in both years? 



A) 
B) 
C) 
D) 



24 
48 
60 
80 



A) 
B) 
C) 
D) 



510 
602 
1,010 
1,510 
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Armed Services Vocational Aptitude Battery 
(ASVAB) 

In 1973, the draft was ended and the nation entered 
the contemporary period in which all military re- 
cruits are volunteers. Three years later, in 1976, the 
Armed Services Vocational Aptitude Battery 
(ASVAB) was introduced as the official mental 
testing battery used by all services (Table 1, p. 18)* 
The ASVAB combined the AFQT and special apti- 
tude tests that differed for the services into one 
battery that today includes 10 subtests. 

In 1980, the ASVAB was normed on a representa- 
tive sample of some 12,000 young adults aged 16 to 
23. Figures 10-14, (pp.35-39) show sample, simulated 
items similar to those in each of the 10 subtests of the 
ASVAB* The figures are based on analyses in which 
all subtest scores were converted to standard scores 
on a common scale with a mean of 500 and a standard 
deviation of 100, The items in the figures are posi- 
tioned at points on the scale where the probability is 
50 percent that persons with that score will correctly 
answer the item (Bock & Moore, 1984, p. 76), This 
format makes it possible to compare scores across 
the different subtests. 

Findings 

Technological Literacy Levels of Young Adults. Date 
from the 1980 norming study are summarized in 
Figure 8, p.33. Because the ASVAB includes exten- 
sive assessments of technical knowledge from sci- 
ence, electronics, etc., Figure 8 is sublabled as 
'Technological Literacy" levels of young adults. 

If the figure is read from right to left, it is apparent 
that females out perform males on the speeded tests 
of Coding Speed and Numerical Operations, and on 
Paragraph Comprehension. The sexes are about equal 
on Word Knowledge and then they start to diverge, 
with males performing better as the tests move from 
Mathematics Knowledge, through Electronics In- 
formation and General Science information, to the 
final test, Auto & Shop Information, at which White 
males out perform White females by some 1 .5 stan- 
dard deviations. 



While the same trends for gender hold for Blacks, 
overall, Blacks perform on the average well below 
Whites across all subtests of the ASVAB. These data 
suggest that Blacks in general, and White and Black 
females in particular will likely be underrepresented 
in occupations that require technological knowledge 
backgrounds in the domains sampled in the ASVAB. 

Evidence for "Vast Bodies of Knowledge" in Liter- 
ates. Figure 9 (p. 34) shows correlations among the 
ASVAB subtests. Reading from left to right, the top 
figure shows how Paragraph Comprehension corre- 
lates with other "general literacy" subtests of Word 
Knowledge (.80), General Science , Arithmetic Rea- 
soning, Mathematics Knowledge, Numerical Op- 
erations and with the more specialized bodies of 
knowledge in Electronics Information, Coding Speed, 
Mechanical Comprehension, and Auto & Shop In- 
formation (.43). 

The bottom figure shows how persons with technical 
knowledge, such as Automotive and Shop Infor- 
mation, tend also to possess other, related technical 
domains of knowledge as indicated by the correla- 
tions of Auto and Shop Information with Electronics 
Information (.75), Mechanical Comprehension, and 
General Science and lower correlations with "gen- 
eral" domains of knowledge. 

Together, the positive correlations of Figure 9 reveal 
that, in general, persons who are knowledgeable in 
one domain of knowledge are likely to be informed 
in other domains, too. On the other hand, those low 
in one domain of knowledge, are likely to be low in 
others, too. Of course, the correlations are far from 
perfect, and so there can be considerable shifting 
around of people in samples of the population. 
However, it is unlikely that a person at the high end 
of the scale on Paragraph and Word Knowledge will 
fall to the low end in Electronics Information or 
Mechanical Comprehension (though it is possible - 
just not highly probable). 

These findings are consistent with the study of the 
interrelationships of six major, commercially 
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available reading tests with the AFQT. In that study 
all of the correlations were in the range from .80 to 
.95 (Waters, et. al., 1988, p. 46, Table 15). Given the 
range of the test-retest reliabilities of the reading 
tests ( from .77 to .92), (Waters, et. al., 1988, p. 30, 
Table 6) these intercortelations of AFQT and read- 
ing test scores are about as high as they can get. 

In short, these data suggest that highly literate per- 
sons will, by and large, possess vast bodies of 
knowledge and perform relatively well across a 
large set of domains of knowledge. Conversely, the 
least literate will tend to perform uniformly low 
across these domains of knowledge. This means that 
if programs of adult literacy are to move students to 
high levels of literacy, they must assist the person in 
developing vast bodies of knowledge across a large 
set of domains of knowledge. 

The ASVAB Subtests 

Word Knowledge, is a vocabulary test of 35 items 
that emphasizes knowledge from the long term 
memory to match stem words with the correct al- 
ternative (Figure 10, p. 35). 

Paragraph Comprehension, is a reading compre- 
hension test of 1 5 items that emphasizes knowledge 
in long term memory and the drawing of inferences 
in working memory (Figure 10, p. 35). 

General Science, is a 25 item test of the knowledge 
base in various domains of science (Figure 1 1 , p. 36). 

Arithmetic Reasoning, 30 items that emphasize 
reading and mathematics knowledge and processing 
in working memory (Figure 1 1, p. 36). 

Auto & Shop Information, 25 items testing knowl- 
edge of tools, equipment, and procedures used in 
working with automobiles and other crafts (Figure 1 2, 
p. 37). 

Mathematics Knowledge, uses 25 items to assess 
knowledge of content and operations from geometry 
and other aspects of mathematics (Figure 1 2, p. 37). 



Mechanical Comprehension, a test of knowledge of 
principles from physics and other sciences with 25 
items (Figure 13, p. 38). 

Electronics Information, a 20-item test of knowl- 
edge of electrical and electronics facts and principles 
(Figure 13, p. 38). 

Numerical Operations, is a 50 item test of how 
rapidly one can add, subtract, multiply and divide 
whole numbers. It is rarely entirely completed (Fig- 
ure 14, p. 39). 

Coding Speed, is a speeded, 84-item test in which 
codes for items given in the stem must be rapidly 
matched to items in the multiple-choice alternatives. 
For instance, in the stem, room is coded 2864. In the 
sample question, the number alternative c must be 
circled for the word room (at figurel4, p. 39). 

Four subtests on the ASVAB are combined to form 
the AFQT. From 1976 to 1980 the AFQT was made 
up of the subtests of word knowledge, arithmetic 
reasoning (word problems) spatial relationships (for 
example, determining what kinds of boxes might 
result from folding two dimensional drawings), and 
mechanical comprehension (for example, if a lever 
is moved on a piece of equipment, what cogs and 
gears would move and produce a change in the 
equipment). From 1980to 1988, the AFQT consisted 
of word knowledge, paragraph comprehension, 
arithmetic reasoning, and numerical operations 
(rapidly adding, subtracting, multiplying and dividing 
up to two digit numbers; no one completes this 
speeded test). In 1988 numerical operations was 
dropped and mathematics knowledge was added. 

As with the earlier AFQT, the ASVAB-AFQT is 
considered as a measure of "trainability." Percentile 
scores on the AFQT are divided into five categories. 
Applicants scoring in categories I and II are con- 
sidered to be "well above average" and "above 
average" in trainability. Category in represents 
"average" trainability, while category IVs are "be- 
low average." Those scoring in category V are 
considered "well below average" in trainability, and 
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as mentioned earlier, are excluded by law from 
military service. In effect, this makes the AFQT the 
only nationally administered test of basic skills 
(reading and mathematics) with a Congitssionally 
mandated standard for employment - though it is 
employment in the armed services (Office of the 
Assistant Secretary of Defense: (Force Management 
and Personnel), 1987, pp. H-12 - 11-14). 

Today, the AFQT and special aptitude subtests of the 
AS VAB are used both to screen out lower aptitude 
applicants from military service, and to classfiy 
applicants according to occupations for which they 
qualify. As in earlier times, education standards are 
in effect, and non-high school graduates must have 
higher AFQT scores than graduates with qualifying 
special aptitude scores. Alternative diploma holders 
(high school equivalency; GED) must also have 
higher AFQT scores than typical high school di- 
ploma graduates. 
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Armed Services Vocational Aptitude Battery 



600 r- 




+1SD 



Mean 



-1SD 

"BM 



'Technological Literacy" Levels of Young Adults 
Vocational Aptitude (Literacy) Tests 



300 



Tests: 



AS 
AS 
MC 
GS 
EI 
AR 



Legend: 

Source: 



MC GS EI AR 
Auto & Shop Information 
Mechanical Comprehension 
Genera] Science 
Electronics Information 
Arithmetic Reasoning 



MK WK 



PC 

MK 

WK 

PC 

NO 

CS 



WF - White Female 



WM - White Male 



NO CS 
Mathematics 
Word Knowledge 
Paragraph Comprehension 
Numerical Operations 
Coding Speed 



BP - Black Female 



BM - Black Male 



Bock. R. D. and E. G. I Moor (1984. February). Profile of American Youth. Washington, DC: Office of the Assistant Secretary of Defenie 
(Manpower. Installations and Logistics). 
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Figure 9 



ASVAB Knowledge Tests 



1.0 r- 



Correlation of the "General Literacy" 
Test of Paragraph Comprehension 
With Other Tests Ranging from 
"General Literacy" to More "Specific Literacy" 




V 1 


WK GS AS MK 


NO 


EI CS MC AS 


* "General Literacy" 




"Specfic Literacy" * 


WK 


« Word Knowledge 


EI * 


Electronics Information 


GS 


* General Science 


CS = 


Coding Speed 


AK 


* Arithmetic Reasoning 


MC = 


Mechanical Comprehension 


MK 


« Mathematics Knowledge 


AS * 


Automotive & Shop Information 


NO 


* Numerical Operations 







Correlation of the "Specific Literacy" 
Test of Automotive & Shop Information 
With Other Tests Ranging from 
"Specific Literacy" to More "General Literacy" 




"Specific Literacy' 



General Literacy" 
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Armed Services Vocational Aptitude Battery 



600 



Word Knowledge 



600 



500 



WK-33 BcKfill most nearly means 

a. cover again 

b. turn over 

c. take away 

d. open to view 



500 



400 



WK-34 Solitary most nearly means 

a. sunny 

b. being alone 



Paragraph Comprehension 



400 



300 



WK - 6 They inttalM the engine in the 
truck 

a. removed 

b. mounted 

c. repaired 

d. changed 



300 



PC - 14 People in danger of falling for ads 
promoting land in resort areas for 
aa little as $3000 or $4000 per 
acre should remember the maxim 
"You get what you pay for." Pure 
pleasure should be the ultimate 
purpose in buying resort property. 
If it is enjoyed for its own sake, it 
was a good buy. But if it was 

I purchased only in the hope that 
and might someday be worth far 
more, it is foolishness. 

Land investment is being touted 
as an alternative to the stock 
market Real estate dealers 
around the country report that 
rich clients are putting their 
money in land instead of in stocks. 
Even the less than wealthy are 
showing an interest in real estate. 
But dealers caution that it s a Tut 
or miss" proposition with no 
guaranteed appreciation. The big 
investment could turn out to be so 
much expensive desert wilderness. 

The author of this passage can 
best be described as 

a. convinced 

b. dedicated 

c. skeptical 

d. believing 



PC - 3 When people move into a new 
town and become aware of 
specific features of the area, they 
soon learn that towns vary as 
much as people. No two towns 
are the same; no two states are 
the same. Hence people must 
solve living problems in new 
ways. Also, just as no two towns 
are the same, no two people have 
the same problems. 

According to the passage, towns 

a. are all the same 

b. vary only slightly 

c. vary as much as people do 

d. are similar in the same state 



Source: Bock. R. D. and E. G. J. Moore (1984. Febnisry). Profile of 
American Youth. Washington. DC: Office of the Assistant Secretary of 
Defense (Manpower. Installations and Logistics). 7741. 



Simulated Items at different difficulty levels from the Armed Services 
Vocational Aptitude Battery ( ASVAB Form t) used in the 1980 renorming 
of the ASVAB (higher scale number indicates greater difficulty.) 
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Figure 11 



Armed Services Vocational Aptitude Battery 



600 



General Science 



500 



GS - 24 - 40° Centigrade it the same at 

a. 0° Celsius 

b. 0° Fahrenheit 

c. -40° Kelvin 

d. -40° Fahrenheit 



600 



Arithmetic Reasoning 



500 



400 



GS - 13 We tee the moon mainly by 

a. light reflected from earth 

b. glow from moon's phoshere 

c. starlight 

d. light from the sun 



AR-28 Two partners, X and Y, agree to 
divide their profits in the ratio of 
their investments. If X invested 
$3000 and Y invested $6000, what 
will be Ys share of a $22,000 
profit? 

a. $8,250 

b. $16,000 

c. $6,000 

d. $5864 



400 



AR - 22 If a cubic foot of water weighs 

551bs, how much weight will a 75- 
1/2 cubic foot tank trailer be 
carrying when fully loaded with 
water? 

a. 1373 lbs 

b. 3855 lbs 

c. 4152.5 lbs 

d. 2231.5 lbs 



300 



GS - 5 Hawks are mainly 

a. scavengers 

b. predators 

c. vegetarians 

d. insect-eaters 



300 



PC - 3 A man writes a check for $100 
when he has only $70.50 in the 
bank. By how much is he 
overdrawn? 

a. $170.50 

b. $ 29.50 

c. $100.00 

d. $ 30.50 



Source: Bock. R.D. and EG J. Moore (19S4, Fcbnury). Profile of 
American Youth. Washington* DC: Office of the Assistant Secretary of 
Defense (Manpower. Installations and Logistics), 77-81. 



Simulated Items at different difficulty levels from the Armed Services 
Vocational Aptitude Battery (ASVAB Form S) used in the 1980 renorming 
of the ASVAB (higer scale number indicates greaser difficulty.) 
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Figure 12 



Armed Services Vocational Aptitude Battery 



600 



Auto & Shop Information 



600 



Mathematics Knowledge 



500 



AS • 24 Which of these adjustments is 

needed for an automobile driven at 
high altitudes for the first time? 

a. decrease concentration of antifreeze 

b. adjust mixture in carburetor 

c. bleed brake line 

d. increase air pressure in tires 



500 



MK-23 


If j and k are positive whole 




numbers and j + k « 12, what is 




the greatest possible value of jk? 




a. € 




b. 36 




c. 32 




d. 11 



400 



300 



AS - 6 Which of the following mechanical 
devices is NOT a part of the com- 
bustion system of an automobile? 

a. piston 

b. carburetor 

c. brake cylinder 

d. fuel pump 



400 



AS-3 




This is the proper saw for 

a. cutting a copper pipe 

b. mitering a picture frame 

c. cutting Bel ss wood on a curve 

d. cutting a 2 x 4 in half 



300 



MK-12 L„ 



In the drawing above, JK is the 
median of the trapezoid. All of the 
following are true EXCEPT 

a. U-JN 

b. a»b 

c. JL-KM 
c. a#c 



MK-2 



The greatest common factor of 
16, 24, and 96 is 



a. 8 

b. 2 

c. 16 

d. 12 



Source: Bock. R.D. and E. G. J. Moore < 1 9*4, February ). Profile of 
American Youth. Washington* DC; Office of the Assistant Secretary of 
Defense (Manpower, InsuUauons and Logistics), 7741. 



Simulated Items at different difficulty levels from the Armed Services 
Vocational Aptitude Battery (ASVAB Form 8) used in the 1980 renorming 
of the ASVAB {higher scale number indicates greater difficulty.) 
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Figure 13 



Armed Services Vocational Aptitude Battery 



600 



Mechanical Comprehension 



500 



MC-23 



C tef > 

Gear C is on the same shaft as 
gear D. Two gears that turn in the 
same direction when the device is 
turned on are 

a. AandC 

b. BandC 

c. C and E 

d. BandE 



Electronics Information 



600 



400 



MC-23 




If these two bridges are con- 
structed of the same materials, 
which will be stronger? 

a. B 

b. A 

c. cannot be determined 

d. they are equally strong 



500 



EI - 20 Which of the following is mea- 
sured in watts? 

a. electrical power 

b. electrical resistance 

c. electrical potential 



400 



EI -10 if an electric clothes drier fails to 
reach the proper temperature at a 
chosen setting, the first thing to 
inspect is 

a. fuse 

b. thermostat 

c. vent 

d. drum rotation 



300 



MC-2 




Casters have been placed on these 
table legs mainly to 

a. make the table higher 

b. protect the floor 

c. distribute table s weight 

d. reduce friction when table is 
moved 



300 



EI - 5 Samuel Morse is generally 
credited with inventing the 
modern 

a. steam engine 

b. telephone 

c. incandescent light 

d. telegraph 



Source: Bock. R. D. and E. G. J. Moore ( 1984. February). Profile of 
American Youth. Washington. DC: Office of the Assistant Secretary of 
Defease (Manpower. IniuiUtiow and Logistics). 77-81. 



Simulated Items at different difficulty levels from the Armed Services 
Vocational Aptitude Battery (ASVAB Form 8) ased in the 1980 renorminf 
of the ASVAB (higher scale number indicates greater difficulty.) 
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Figure 14 



Armed Services Vocational Aptitude Battery 



Numerical Operations 



Now look at the sample problem below. 
3x3 

a. 6 

b. 0 

c. 9 

d. 1 

The answer is 9, to the C answer is correct. 



Coding Speed 



Look at the practice Key and the five sample questions below. 

KEY 



Br.: 



.2715 
.1413 



man . 
room . 



.3451 
2864 



salt, 
tree. 



4586 
5972 



SAMPLE QUESTIONS 




ANSWERS 






A 


B 


C 


D 


E 


room 1413 


2715 


2864 


3451 


4586 


green 2715 


2864 


3451 


4586 


5972 


tree 1413 


2715 


3451 


4586 


5972 


hat 1413 


2715 


3451 


4586 


5972 


salt 1413 


2864 


3451 


4586 


5972 



Source: Bock, R. D. and E. G. J. Moore (1984, February). Profile of 
American Youth. Washington, DC: Office of the Assistant Secretary of 
Defense (Manpower, Installations and Logistics). 77*81. 



Simulated Items at different difficulty levels from the Armed Services 
Vocational Aptitude Battery (ASVAB Form 8) used in the 1980 renorming 
of the ASVAB (higher scale number indicates greater difficulty.) 
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Testing Of Adult Literacy In The Civilian Sector 



Data are presented for civilian assessments of adult 
literacy spanning over a half century (Table 3)* With 
the exception of Buswell's study that sampled 
adults in the Chicago area, the other studies have 
used a nationally representative sampling of either 
young adults or the full range of adults. 

Starting with Buswell's study in 1937, civilian 
surveys of literacy skills have gone beyond the 
assessment of reading and mathematics from an 
"academic" perspective, like those followed in the 
military tests, to an approach in which the academic 
skills of reading and mathematics are applied to the 
performance of "real life," or "functional" tasks. 
This includes such tasks as reading movie or TV 
advertisements, figuring the price of items in a 
grocery store advertisement, following instructions 
in recipes, locating information in train schedules, 
filling out various forms and so forth. 

The civilian adult surveys of literacy are also more 
likely to use open-ended, constructed response items 
rather than relying solely on multiple-choice items 
as do the military tests. However, neither this nor the 
use of "real world" tasks has seemed to have affected 
major trends in the findings with either military or 
civilian literacy tests. 



Education and Literacy Practices 

As a general trend, as the amount of education goes 
up, so, too, does the amount of reading and the 
variety of materials read. Better educated adults read 
books, magazines, and newspapers more often than 
do less well educated adults (see Figures IS, p. 43, 
33, p. 63, 68, p. 99, 82, p. 113). 



Literacy and Ethnicity 

On both the military's Armed Services Vocational 
Aptitude Battery (Figure 8, p. 33) and the National 
Assessment of Educational Progress's Literacy: 
Profiles of America's Young Adults, across all lev- 
els of education, Whites exceed the performance of 
African-Americans, and Hispanics fall in between 
(see Figure 91, p. 137). These are essentially the 
same findings as with the Army's Alpha and Beta 
tests in 1917 (Figure 3, p. 23) when the latter was 
used with non-English speaking recruits as well as 
with low literates. 



Education and Literacy Skill 

In both military and civilian literacy assessments, 
performance is strongly influenced by the amount of 
formal education the adults have. Higher educated 
adults perform better than those with medium 
amounts of education and the latter out-perform the 
least educated adultsThus, as a general trend, greater 
amounts of formal education are associated with 
greater amounts of literacy skill, i.e., greater ability 
of adults to perform both "academic" and "functional, 
real world" tasks, (see Figures 15, p. 43; 30, p. 59; 
33, p. 63; 37, p. 67; 68, p. 99; 82, p. 1 13). 



05 Bu$weW& Study of Adult Literacy Skills in Chicago 

50 



1937 



41 



TableS 


Testing Adult Literacy In Civilian Studies 


Study 




Year of 
Study 


SubltttA of 

Study. 


In Assessment 


Buawell's Study of 
Adult Literacy Skills 
in Chicago 


1937 


Chicago Area 
Adult* (N*1020) 


Reading: 
Price lists 
Telephone Directory 
Newspaper Movie Ads 
Paragraph Comprehension 
Vocabulary Knowledge 


National Assessment 
of Educational Progress 


1970 


Representative 
National Sample of 
Adults 26-35 Years 
of Age 


Understanding Words 
Reading Graphic Materials 
Follow Written Directions 
Using Reference Materials 
Gleaning Facts from Prose 
Reading for Main Ideas 
Drawing Inferences 
Critical Reading 


Harris Survey: Survival 
literacy Study 


1970 


Representative 
National Sample of 
Adults 16 Years of 
Age and Older 
(N«l,685) 


Completing Forms For: 
Social Security 
Bank Loans 
Public Assistance 
Medicaid 
Driver's license 


Adult Functional Reading 
Study 


1973 


Nationally 
Representative 
Sample of Adults 
in Households 
16 Years of Age 
and Older (N=l,537) 


Readincr Of* 

Signs, Labels, Forms 

Periodicals, Books 

Legal Documents, Letters 

Notes, Instructions, Listings 

Advertising 


Adult Performance 
Level Study 


1974 


Nationally 
Representative 
Sample of Adults 
(N-1537) 


Knowledge In: 
Consumer Economics 
Occupational Information 
Community Resources 
Health, Government & Law 
Skill In: 
Communication 
Computation 
Problem Solving 
Interpersonal Relations 


NAEP Literacy: 
Profiles of America's 
Young Adults 


1985 


Nationally Repesentative 
Household Sample of 21-25 
Year Olds in the 48 Contiguous 
States (N«3600) 


Prose, Document, & 
Quantitative Literacy 


NALS 

National Adult Literacy 
Survey 


1993 


Nationally Representative 
Household Sample in 50 States 
of Adults 16 to 65 + <N«26,000) 


Prose, Document, & 
Quantitative Literacy 
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BuswelTs Study of 

Adult Literacy In Chicago - 1937 

In 1937 Guy Buswell, of the University of Chicago, 
published the results of studies of reading conducted 
with some one thousand adults having various years 
of education who lived in the Chicago area. He 
developed a battery of tests that measured skills in 
reading functional materials such as food ads, tele- 
phone directories, and movie ads, as well as more 
traditional "academic" tests of paragraph compre- 
hension and vocabulary knowledge. 

As another indicator of reading skill, Buswell ob- 
tained eye movement data for most of the adults. 
These data made it possible to see how reading skill' 
changed as a function of education when measured 
in terms of the percent of one line of text that could 

be read in one second. 

i 



In addition to measures of leading skill, Buswell also 
obtained data on reading practices of the adults. In 
interviews with the adults, regarding newpaper and 
magazine reading, the question was asked: "Do you 
read newspapers and magazines regularly, only oc- 
casionally, or not at all?" In regard to books, the 
question was stated: "Do you read many books, few 
books, or none?" 

Figure IS summarizes the results obtained by Buswell 
for both reading skills and practices. As indicated, 
both skillsandpractices increase asyearsof education 
increase. This suggests that one function of educa- 
tion is to guide readers to read more and that reading 
more leads to greater skill. In turn, this may lead one 
to be more successful in school and to pursue further 
education, thus leading to greater reading practices 
and greater skill and so forth. 

The reading test items that Buswell used are given in 
Figures 16-21. 



Figure 15 



Literacy: Chicago - 1937 
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literacy Skill 



<6 7-8 9-10 

Last School Grade Attended 



1M2 



• Reading Test Score N ■ 897 

• Reading Speed Score N « 904 



100 



90 



80 




10 



13+ 



Source: 



Source: 



Literacy Practice 



<6 7-8 9-10 11-12 13+ 

Last School Grade Attended 

Read Newspapers N « 975 
Read Magazines N ■ 975 
Read Books N« 975 

G. BufweH(1937, August)* How Adults Reed. Supptemenuvy 
EducMtonslM o e o ftiph s . Number 43. Chicago: UnivenityOf 
Qvcsgo Prcst. (p. 27, table 4). 
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Figure 16 



Buswell Reading Test Item 



PRICE LIST 




FIND THE PRICES OF THE FOLLOWING ARTICLES; 

cans toothpicks 

wool duster 

3-oz. bottle Montclair Ginger Ale Extract 

roll adhesive tape 2 in. wide 

1-qt bottle Liquid Meat Smoke 

can Nu-Dex Fabric Cleaner 

balls while cotton twine 

doz. Mason jar caps ■ 

pkgs. Junket tablets 

box assorted codes 

Slite-O-Hand Cleaner (pint) 

bottle of Vegetable Butter Color 

can Egg Preserver 

roll adhesive tape 1 in. wide 

16-oz. pkg. Legg's Old Plantation Seasoning 

box Rennet tablets 

doz. red one-lip Canning Rings 

vial Cheese Color tablets 

bag corks - pint size, No. 7 



Source: G. 3ttiwdl (1937, August). How Aduiti Read. Supplementary Educational Monographs. Number 45. Chicago: 
University Of Chicago Press, (p. 1 49). 
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Buswell Reading Test Item 



TEST 2 



Ahkott Ju 9 9970 Uaral 7901 

Aitkaa final 97a 9Ut ar M10 

Alaaarf livt M 1919 11* r* 7110 

lalirNi Xr*. Dara, 441 BUga 911 

Aagala A T 109 Daaglaa «t 0491 

Antm C X 9944 Barrypaia* 9999 

JattU Xmut 991 Xatar 9901 

Mir Baraia 409 X Mapla 999 

later DuMtt Ut I Farlaay 9499 

Baker Jot* t 144 BwiBir *r 097 

Baker Imnd 1 9999 Baa* 9799 

hrtorlliyt« 991 filrrtm ar 111 

IimH Claaie 990 Ut Marl* 199' 

Berqulet Iflrle X 919 Oths 9199 

Blaki Xilte* 991 Blaakthara 9991 

Bleaker* Km 1919 1 2M 4401 

Beelk* X J 909 Dtrm ft 1497 

kn» Oh F 1999 W 7th 9099 

Beyatea Br* iMdM 99 X lltk 9099 

r?Mk Baa J It X 9tete 1999 

Br«C«S M 919 ff 9 9 fa 9* 9799 

Brae* LyaAaa 0 919 Vtlea At 9409 

lm Xlaade 199 Caael 199* 

Bream Boat 904 falser 990 

frU 119 Bm114 4999 

Xe*4 941 Dyer 9991 

Car Imb Xr« X?m 9U1 Bairn 4990 

Cerleea D T 999 fairkeake 114.* 

Cerlae* 0 T 907 UnoU 0994 

CatlU fraek 0 999 twain 9999 

Clark free* W 919 Oak 9999 
Clark OaralA X 19 X 71m 

Clark Jeft* 49 0 — In 9909 

Ceaeteek Deal X 79 lerrieea 9999 

Ceoley Xalph 741 Clareaee ar 7499 

Ceerrier T J 790 Jewel 9999 

Cartls Be* J 499 gterllag H 4909 

Certie Bay J 91 Ukerty 199-J 
Oaalele Zaekary 411 Tark rt 

Oaaly Km 940 Are* 7991 

OeLaag Alas 4909 Half rt 170-X 

Deeyer Ms X 909 Cheeeamt 9011 

Plttaam fee* 0 990 Dirlaiam M2-J 

Oeaehee Fraak 419 fleiatteU 9949 

Oeaaltiea Xllkert 199 feeall 4990 

O eae i a m Jee W 199 Sagea* 9997 

Bo a t— Julia* 909 Xegeai 99741 

Xlgrig Xra lata 941 X 9x9 9999 

Xla*a Beaee 949 Oaktee 1999 

Brlekeaa Artker ? 997 ferret 9799 

Xee X 9419 Vftlm 190-J 

Wut X 9419 *1» 9900 

OUrer 191 9heraaa 999 

lerrell Leeie 909 Xeaeell SOU 

fkrrell Bart 0 79 Aageeta 997«X 

flatakar X X 199 Nam 9910 

fleteeaer Leeearu 949 Wtek 7190 

flett Bay 909 Aaaaa 404 

Trial Xra Delia 990 Cary ar 9299 

Gettery L X 199 fhtraaa 191 



I J 193 Sher 
l *ae 900 JJkioa 
Cillatala Xiaalaa 499 iaatU 
Oaatt Kte 190 Oleoriev 
Garaakl Tutor Ut Oraaalaaf 
Ore** Xilte* 991 9e**et 
Oretvee 1 X 101 Aeklaa* 
Orabk P— 19 449 Ckarah r* 
flaag 9afla 19 XaaaaU 
Xall Allaa 999 Bteeart 
Ball Ami X 149 Uay4 
XaU Markka 99 Oalf 
mai Xalpk X 941 OraaA 
■rink— if Karris 199 Orora 
Xefrar Belter 747 Orehar* 
Xeffcer Xelleee 747 Orkaay 
Bbrt Jet Cm 709 Blacre 
B1U Cllffere 171 Cevtral 
Xakart Cher X 999 tamest 
Xekerg Fatk 90 Xillev r* 
Xakart Jala 999 Craat pi 
Xeeeer Jeke 999 Oraat pi 
ftejkee w T lio Alaauaar 
Xatkott XalaalM 704 JaAaoa 
Xaaa» Farkar 919 V 109 
JaveXaaky Pakar 994 Aak 
4aaaam irtkar 941 Caaaaaa 
Jokawoa X L 909 X 109rd 
Joaaaca B T 909 X 109th 
Johtuutt Gaa X 294 tat H 
Jataaaa Jain 711 9iac»r 
Jakaaam Jaka 199 Wiaaii 
tally Xkatr C 947 Xantar 
larry Xlaar 949 9araaaak 
ri—ir Bakt 94 tcakpart 
Uaaay frank 499 X 9th 
Xaak MrC 990 Caatral 
Xaakla Urn 990 9kirUaa 
Xa«l Alkart 94 BaaAaa 
Uad B t 909 Vaaklactea 
laaiaa Xarria 999 Xaary 
Uraaa 9 B 797 X Taylor 
iaraaa B T 979 Aaaaa 
Uraaaa Taraaa 191 Bl<hlaa4 
laXaa tkat 111 Uka 

i Fraak 999 Plaaaaat 
i Birt 990 Bagara 
990 Xaaal pi 
UrUwr Xaary 997 Cllataa 
Xaaftmaa Jatx X 199 oiaa 
Xaftaraaa J«k« X 171 Bla^a 
X i B ii a Boaar 407 laylar 
XtfAaaay Ctes A 949 X 199th 
Xaart Xalpk X 191 Taft ri 
Xarrall tea 909 X Xpria* 
Xayart t A 491 Craaa 
Hayara Oraaa 971 DlaaaaA 
Xayara Barry 9 ttt Plaa 
Xaaarak Ml 49H XaaAaa 
9aad 702 Aah 



190 
7901 
1991 
7901 

190 
999 
990-B 
9990 
9591 

row 

4991 
779 
9*9-* 
9990 
9490 
949 
1999 
197 
998 
940 
190-B 
990-B 
910»B 
210-X 
990-W 
999 
997 
4999 
999 
499 
9990 
990 
990 
9479 
9910 
118 
9990 
9440 
9902 



4970 
144-X 
4990 
9299 
4999 
9999 
1799 
7990 

990 
4490 
0997 

479 



999 
149-J 

999 
4999 

119 

993 
19** 



Source: G. Buswell (1937, Aujutt). How Adults Read. Supplementary Educational Monographs. Number 45. Chicago: 
University Of Chicago Press, (p. 1 50). 
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Figure 18 



Buswell Reading Test Item 



TEST 2— Continued 



Houmi Aatoa 102 Xrrlnc 
Uarphy Cloronoo W 714 * 144th 
toir Blahard 161 ftooroon 
Bopior Bofor 3S7 Qalaoy 
Bowlan Bo«or 447 tarlx* 
ttoxton aartia 4f 7 lm ax 
Bo rthx oo d P«rU 134 X Slot 
O'Brloa Fxtk ISO Uadoa 
O'Koofo Patk IIS Bikaii 
Ooooky J Ha ItS liiMMla 

OV MM iMMl 141 Mil 

Fart! Alfrod 141 Doxxotor 
Fati Foal ttt Courtload 
Nlntr Mil ltt Clrraland 
Httrt bnu 41 Biror rd 
Iter* 4S4 Blllalda 
Pilohor T F 42 aarriaoa 
Polan 445 W 14th 
Poland Max John 241 Hoaoror 
Pexall Jet 719 ColxaMa 
GoiCloy Vrt 24a 713 Pox 
Bap* Arthur 111 Lincoln 
Bodxaa Bortha 444 Doxnar pi 
Soloo Cloronoo 171 Ollxor 
Blohardo Prod T 344 Yinoont 
Blohardo Bofh 473 La Grand 
Rink xa 472 Walnut 
Bolandar Braott 447 Taylor 
Roloff toward 42 Blraroldo 
lolaaaa Proaol* 755 I tomtit 
tahaffor Androx 142 Bldcoisnd 
tohoffor Am 444 Waohincton 
tohooffor Barry 507 Band rd 
teharfar Boaa 122 Plua 
3ohooni(or rani 441 Aaalin 
Sahuloaxorc Bayxond 473 Oak 
Schaxan Mrs An? 220 Shoro 
Sohoxan Jac JS47 Biokory 
Shannon Buoooll 422 Craaoamt 
Shirxxod Palo C 170 Foliar 



444 

3442 
214 
4447 
13W 
3274 



422 

144-11 
149-K 
244.11 
294-J 
334-1! 
44-J 
64-M 
464-V 



4545 
6945 
314 
317 
3174 
312*11 
312-4 
4445 
4422 
£43 
1544 
584 
6254 
4147 
414-11 
414*4 
4414 
4144 
7477 
7977 
764-J 
6942 



Slfoalt Otto 133 Brxaou 5499 

tkala Jot 144 W 22nd 4732 

txdth Clifford 322 W 122 pi 5422 

Snlth CUfton 333 Karoo 64S-J 

•mth Dxrid e 47a lit*!*** 222 

txdth Frank 44 W 21ot 3352 

xalth aro Lamra 1404 Clark 2444 

txdth OliTor 140 Uko 47441 

txdth Baloh 140 Grand 77S-h* 

ttrond Xanax 417 Toxor rd 975W 

tana Worroa 224 Cardan 444-4 

Sxanoon Allan 131 Xaat 193-J 

thiaaoon Ouot 209 Clinton 4599 

Vhoxpaon Clam 731 X 10th 4555 

Thonxoox aomon 474 Groxo 7972 

Toxao Oooao 720 Graoo 9972 

Toxnoond ffoltor 727 Floroo 4587 

Toxaooad Ihoo 354 Xxxahoo 422-1 

Oxdorxood John 329 B 32nd 9342 

Taxdoroook Floroo ISO loot 9332 

Yondorllp tail 476 t 7th 4331 

Yondorpool Soloa 675 Colin* 241 

Xahl Goo 44S Bill 5882 

Wall Goo 941 Croooont 422-U 

Xalth Tin 220 Braaaxny 423-k 

xohor xa 7310 Baot At 2232 

Xoloh ttanloy 144 Bo*ol 2322 

Xootoott Fhillp 140 Shoridan 222 

Whiddon Mary L 143 Loan 3232 

Wldfor Alox 711 Spmoo 323-B 

Wlllor Chaa A 220 Onion 3323 

Wilooa CUlr C 772 B 4th 323-J 

Wirt Anthony 704 Banooor 4474 

Wonnaoott Looxnrd 702 Gala 4478 

WrUht Ifei W 1006 Dowoy 667-M 

Tounc A B 730 Tircinia 6697 

Tooac C B 770 Hiokory 4879 

Toon* C B 790 Tornon 6699 

Zlaxoraan Chaa 221 Bakar 6890 

Syball Prod W 244 TThito 4498 



xBtn rm tsispbob bobbers of the pouonBO icbsoxs ib the spaces bblox 



xx. Rink, 472 xalxxt 




Boto taharfor, 122 Plxx 




toxort Broxn, 804 Pnlaor 




John John* on* 711 tintar 




Bay rixxt, 409 Aaax* 




Cllftaa tnixhi 333 Voroo 




0. T. Carlton, 407 Liaoola 




Aan B. Ball* 142 Lloyd 




Blaxr tarry* 249 taraaxah 


Dunoon Bakar* 117 B. Forkxay 




Ball Toadorllx. S7t E. 7th 


Sort 0. Forrollf 72 Anfutta 




Barry t. xoyoro, 442 Pino 


Farkor Xaxan, 616 W. 103rd 


C. B. Taxi, 770 Hiokory 


Joooph 7f. Donovan, 124 Eatoxood 


B# T. Loroon, 374 Adaao 


Boxxrd Bolofft 42 RlTor-ldo 


1 


Frodariok V. Clark* 314 Oak 




wallaoo Bofxor* 747 Orl My 




Thaxno Toxnoond* 344 Xraahoo 




Frank Ooxahuo, 414 Flaihfiold 





Source: G. Butweil (1937. August). How Adults Read. Supplementary Educational Monographs. Number 45. Chicago: 
University Of Chicago Prets. (p.lSl). 
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Buswell Reading Test Item 



TEST 3 

WRITE IK THE BLAME SPACES TEE VAXES OP THE THEATERS 
WHERE THE FOLLOW 1*0 MOVIES MAT BE SEEN MOW. 



I I I I II I M 

tlMAi WIST 



INMC 



NORTHWEST SIDE. 



gaXQET 




•ATIWAT \ 

Ttmrrw-e t>. n> 

IN tMM MM ,«M* 



t-SMfafiw™ 



SOUTH SIDE. 



SOUTHTOWN 




KMO; 



EXfftA! MIXING BOWLS 

ilMM »*-!*€•► MM 



WIRE' 



■tint HM f? mil* tttt *«•*• 



IRVNN 



UBMTY 



LIURlSe -ft 



r»## AMtlfr t« 



PICCADILLY 




I^BttT^-EICKT BELLS" 



•"Hi IN MAN" 



RtMlMwVStttl 



Mvhututi IINilFI 



EIGHT BELLS 



2. ROBERTA 



b. 



3, WEDDING NIGHT 



4. WEST POINT OP THE AIR 



5. 0 MSN 



«• PARTY WIRE 



b. 



7. THE THIK MAM 



8. OUR LITTLE GIRL 



MR* DYNAMITE 



COUNTRY STORE 



00IN* TO TOWN 



12. LIFE BEGINS AT 40 



13. HAUGHTY MARIETTA 



Source: G. Buswell (1937, August). How Adults Read. Supplementary Educational Mono graphs Number 45. Chicago: 
University Of Chicago Press, (p.152). 
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Bu8well Reading Test Item 



TEST 4 



HAD CAUTOXY itfD tBEV AXSHEt THE QOOTIOW. 



Purine * hoary foe tho ttooaohip Cattiao ttrook ft rook aad brok* is two* All 
of tho 78 pottoagort woro thrown iato tho too* Xa tho paalt whioh followod two 
of tho patooagort woro d rowao €• tho othert aad tho aoahore of tho trow woro 
rotoaod by ft pattlag ttoeaor# Tho wrook ooourrod boot Caadoa* tho wrookod hoot 
woo owntd by tho looklaad Stooaehlp Coapaay. 



1* How waay pattoagtrt woro drowadd? 
2* 3hat boooao of tho orowt ____ 
3. Whoro did tho wrook ooourT 



Slant iafoetloat oro ooaaoa aaoag both ohlldroa aad adolto* Aftor tho ia- 
footloa boo boooao flraly oatobllthod, tho rlotia it la for ft lifoloag ttrugglo. 
Slant laibotloao got hot tor whoa froo draiaago oalttt, but got wortt whoaowor tho 
outlott of tho tiaut ftrofto boooao eloggtd or owolloa that* Frooaoatly tho 
lafottloa from ooaaoa eoldt oproftdo to tho slant bono* oad oott up a aero or lost 
porwaaoatly laftttod tm. Frovoatloa of tiaat iaftotloat ooatittt la ottablith- 
ing food hygtalo ooadltloat, with ploaty of froth air, aaoh eaaehiao, aad wall 
ooatllatod tloopiag oaartort* 

1» What hftppoao to tlaut Iaftotloat whoa tho outlott of tho tiautoo boooao 

OlOggOd? ^..^ 

2* Do ohlldroa havo tlaut lafootloaot 



S* What throo thlagt holp to proroat tiaat iaftotloat? 



tho Brooklagt lattltatloa it aa oooaoaio roooarth orgtaitatloa of high 
ropatatlea, looatod at Waohlagtoa. A (roup of oaport oooaoalttt belonging to 
thlo lattltatloa aado aa appraloal of tho faaotloaUc of tho oatioaal looovory 
AaaUlotratloa. Aaoag tthor •oaolutloat thio grow* of oxportt oald that tho 
frootlag of who wago ttraoworo agalaot aay downward roadjaetaoatt larolvod aloo 
a wery ooaoUorablo frootlag of tho prloo ttraotaro. 

1. What did tho oooaoaAott appralooT 

2. What lo tho Brooklagt Xattltatloa? ' 

»• Old tho oooaoaio oxportt tay that whoa wagot woro kopt up prlooo toadod 

to go doamt ^ 

4» Dooo frootlag tho wagt ttraotaro aoaa aakiat wagtt hlghor, ktopiaf thta 
at thoy are, or loworlag laoat 



Source: G. Buswell (I937. August). How Adults Read. Supplementary Educational Monographs. Number 45. Chicago: 
University Of Chicago Preu. (p. 1 53). 
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Buswell Reading Test Item 



TEST 5 
TOCAiOXUT ntt 

Xa the tali U) btlov there is ft eheek before the wrt anj bfMtm it i 
ess* M gg^T la tasyle (!) thsre U a oheek befere sb^/waTsh inm the 
form. 



the 



(A) require obey 
Ilk* 

Authority 
refuse 



(») fern round 

IZrrotty 



SirOSrO 



1. far there 
after 
mm 

4ietant 

"" foreign 


10. hinder raar 

laat one 
risk 

serenade 


19. potential _^ slsatria 

supamatural 
oreteeted 
possible 
" parental 


2* di§*o**r sxplore 
~ travel 

* ^2 
™~ fun* 

fine 


11. taperial oraal 

mmm dang* reus 

royal 
*"*** g ovomor 

colonial 


20. vagabond originate 

frank 

official 

1 vag rant 
purposeful 


Z. r*edy dressed 

harry 
~ * prepared 
~good 
let* 


12. txmlt attract 

taaaoa 

— slailar 
honor 

~" salary 


!il. qualify nodify 

individuality 
~" exoolleneo 

sharaetariatis 


4* attack sseure 

fight 

. unit* 
" "*" blene 
— m surprise 


IS* iaeur disturb 
eontraet 
mmmm astonish 

ourss 
~ dislika 


22. inoito understanding 
out into 

intuition 

"— "" attaak 
~ ' lattig at* 


S. aietake loaa 

srrer 

blaae 

braak 

~4ara 


14. ratal fight 
bufle 
~ celebration 
publish 
sxsitsaaat 


25. largsss mmmm soloasal 
shrub 

tanpo 

gratuity 

^_ enormous 


6* sxaet slailar 
— reiss 
sorreet 
fix 
" shape 


16. seuip transport 
foraa 
olathas 
furnish 
. oarriags 


24. aphanaral pamaitia 

astrononioal 
~" transitory 
supamatural 
. atnoapharia 


7. iomM order 
"~ praise 

"~ s octroi 
organ! s* 


16. pradiat. fear 

MVS 

— " dasraa 
— foratall 
~ fss*la 


26. **(r*g*t* inprison 
immigrate 
isslata 

— tartura 

— daily 


8* brand fir* 
— aaal 

law 

~ nark 

quality 


17* patamal forever 

— paromt 
— " ■ outdoors 

— fathsrly 
mmmm sorrowful 


26. rasslad inpliaat* 

abrogate 
sontossporery 
antagonist 
~ sneliorete 


9. intact aril 

~— prats is 
" nek* 

begin 

purposs 


18* tranquil rural 
slaapy 
treed 
"~ plaaid 
~ arrow 


27. autonomy spontaneity 
~~ pseudonym 

indofandana* 

vehlols 
~" generator 



Source: G. Buswell (1937, August). How Adults Read. Supplementary Educational Monograph! . Number 45. Chicago: 
University Of Chicago Press, (p. 154). 
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National Assessment of 
Educational Progress - 1970-71 

The National Assessment of Educational Progress 
(NAEP) for years 1970-7 1 was unique in obtaining 
data on 21 items for 9, 13, and 17 year olds as well 
as for adults 26 to 35 years old. This makes it 
possible to see how performance on the same items 
improved at different age levels. 

Figure 22 summarizes the improvement in perfor- 
mance of the 21 items at different age levels. The 
figure shows a considerable range of performance at 
age nine, with scores ranging from just over 20 
percent correct to over 90 percent correct averaged 



over the 2 1 items. At the adult level, however, scores 
range from 80 to over 95 percent correct. This 
indicates that developmental^, as children grow up, 
attend school and become adults, they grow pro- 
gressively more literate. 

Figures 23 -28 show the 2 1 items used in the assess- 
ment. Each item shows the information Display that 
was presented to the examinee, the Questions asked 
and the Outcomes for each age level. 

Figure 29 shows average performance for each of the 
21 items for adult Whites and African- Americans. 



Figure 22 National Assessment of Educational Progress - 1971 
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Performance on the National Assessment of Educational Progress for 1971. Responses by all 
age groups to the same 21 questions about 8 different information sources. 

Source: National Assessment of Educational Progreu. (1973, July). Reading: Reading Exceriees. Report 02-R-20. 
Washington, DC: U.S. Government Printing Office. 
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NAEP 1973 Assessment Items 



ITEMS 1 • 7: NAEP Theme: Reading Reference Materials 

B. Use of Listening and Speaking Skills 



DISPLAY 
(Give dictionary to student. 

Ask the first two questions and record the main points of his responses.) 

(If the student defines both words correctly, read 3 - 7 to him and 
record his answers, even if he cannot do some or all of the tasks. If 
he cannot define one or both of the words, give him the definition(s), 
using the dictionary and showing him a word and its definition if 
necessary, then continue with 3. 

If he answers 3. either correctly or incorrectly, continue with 4 - 7. If 
he cannot answer 3, give him the definition(s) once more and repeat 
3. If he then answers 3, either correctly or incorrectly, continue with 
3*7. If he stops working, encourage hirr« to continue. If he still 
cannot answer 3, discontinue, explain the situation in 3, and go to the 
next exercise. 

Note: 

(For more of the answers to the questions, several alternative but 
acceptable responses are jpven in the NAEP Report.) 



Outcomes by 








Age m Approximate School Grades 






Age: 9 


13 


17 


adult 


Grade: 2 


"7 


12 




Percent Correct: 








1. 7V 


93 


95 


94 


2. 17 


78 


90 


83 


3. 01 


97 


98 


97 


4. 53 


91 


96 


93 


5. 93 


98 


99 


98 


6. 71 


93 


97 


97 


7. 65 


95 


98 


95 



QUESTION & RESPONSE MODE 

1. First ask: "What is a dictionary?" 

* (Dictionary: "A book that tells you what words mean." 

"A book that tellsyou how to use words.") 

2. Then ask: "What does the word define' mean?" 

** (Define: "To give the meaning of words," or 

"A book that tells you how to use words.") 

3. Open the book to page 15 and tell me any three words 
defined on that page. 

1. Allied 

2. Almanac 
3. 

4. Tell me the last word defined in the "P" section. 

Pvthon 

5. Tell me the number of the last page in the dictionary. 

632 

6. Tell me the number of the page on which you can find 
out what the word "bake" means. 

il 

7. Tell me the word which is defined just before the word 
"house" and the word which is defined just after the 
word "house." 

Just before Uoadx 
Just after Houatboat 



Source: National Assessment of Educational Progress. (1973, July). Reading: Reading Exercises, Report 02-R-20. Washington, DC: 
U.S. Government Printing Office, (p.37) 
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NAEP 1973 Assessment Items 



ITEMS 8 -12: NAEP Theme: Reading Reference Materials 

B. Use of Listening and Reading Skills 



DISPLAY 

(Give the student a copy of the TV schedule and say to him, 
"Here is part of a TV guide you might find in a newspaper. 
After you have read it. I will ask you some questions about 
it. You may look at the schedule as many times as is 
necessary to answer the questions.**) 



2:00 p.m. 



m 
m 

ta 
® 



Super Mutt - Cartoon 



Baseball ICoiorl 
Teams to be announced. 
(Runs to 4:00: followed by 
Baseball Scoreboard.) 

Top Cat • Cartoons 

Movie • Mystery 

"Master Sleuth** (1945) 

Master detective (Bob Johnston) and 

sidekick (Pat Morgan) are on the trail of 

a deadly escaped convict. 

Sue Jones, Mort Roberts (90min.) 



2:30 p.m. 



G3 Children's Variety [Repeat] 

Today the show goes to Detroit to watch 
cars being assembled (60 min.) 

BD Visit the Zoo Special 

Famous San Diego Zoo is toured. 



3:00 p.m. (fi) Music Beat 

Jay Nickels hosts an hour of popular 
music of local groups 



QTTESTION & RESPONSE MODE 

(Read the questions to the student and record his answers. ) 

8. Which program is being run for at least a second 
time? 

ChtidWLM Variety 

9. If you watched the entire movie, could you also see 
the entire program about the San Diego Zoo? 

CD Yes 

CZ> I don't know. 

10. Why is there no new program listed on Channel 4 
beginning at 3:00 p.m.? 

BaMball f««* tUM until 4 *>° Dm 

11. At what time are the cartoons shown? 

12. How long is the program on Channel 6 at 3:00 p.m.? 

O 30 minutes 
60 minutes 
CZ> 90 minutes 
CZ> 120 minutes 
<Z> I don't know. 



Outcomes by 

Age k Approximate School Grades 



Age: 9 


13 


17 


adult 


Grade: 3 


7 


12 




Percent Correct: 








8. 37 


68 


84 


84 


9. 48 


72 


85 


88 


10. 44 


69 


84 


89 


11. 73 


84 


92 


94 


12. 59 


61 


69 


80 



Source: National Assessment of Educational Progress. (1973, July). Reading: Reading Exercises, Report O2-R-20. Washington, DC: 
U.S. Government Printing Office, (p.37) 
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NAEP 1973 Assessment Items 



ITEM IS: NAEP Theme: 



Reading Reference Materials 
B. Reading for Facts 



DISPLAY 

Read the passage and answer the question which follows it. 

A sports car differs from an ordinary passenger car in 
that its size and number of accessories are limited. The 
sports car also differs from the ordinary passenger car in 
performance. It can attain hightr speeds because it is built 
smaller and lower. For these reasons it can also turn corners 
faster and more smc othly than a passenger car. Alports car 
also generally gets better gas mileage than an ordinary 
passenger car. 



Source: National Assessment of Educational Progress. 
(1973, July). Reading: Reading Exercises, Report 02-R-20. 
Washington, DC: U.S. Government Printing Office, (p.37) 



QUESTION fc RESPONSE MOHE 



13. Which of these is the reason that a sports car can turn 
a corner more easily than passenger cars? 

CZ> Compact size and disk brakes 

CZ> Coil suspension and power steering 

^s» Small size and low center of gravity 

O Great length and minimum of accessories 

CZ> Roui-gripping tins* and n^^ 

CZ> I don't know. 



Outcomes by 

Age (k Approximate School Grades 



Age: 9 " 


13 


17 


adult 


Grade: 3 


7 


12 




Percent Correct: 








13. 42 


69 


89 


92 



Source: National Assessment of Educational Progress. 
(1973. July). Reading: Reading Exercises, Report 02-R-20. 
Washington, DC: U.S. Government Printing Office, (p.38) 



14. 



15. 



ITEM 14 • 16: NAEP Theme: Reading Reference Materials 

B. Reading for Facts 

PISPMY 

Read the passage and answer the questions on the next two 
pages. You may look tack to this page if you wish. 

POISON IVY 

The interval for burning, itching and finally water- 
filled blisters to appear varies a great deal. This, again, may 
depend on some differences in human skin; and the symp- 
toms of dermatitis can develop within a few hours or even 
days later. The most important factor in using any remedy 
or treatment is TIME. Unless you can wash the poisonous 
sap away within 5 to 10 minutes after exposure, you are 
likely to be in trouble. Wash the entire body at once with any 
bland soap and then change clothing which must be laun- 
dered before being worn again. It is, of course, very obvious 
that washing is not always possible immediately after known 
contact with such irritating plants, and a tub or shower after 
outdoor activity is generally too late to avoid dermatitis if 
you have been exposed to or in contact with poison ivy. The 
blister fluid associated with ivy poisoning does not spread 
the iritation; but it is the oily, poisonous resin which is 
transferred to other skin areas by rubbing or scratching. 

There are some simple preparations for treatment of 
ivy poisoning. An easily prepared "remedy" can be made by 
usingequal parts of baking sods and cornstarch with enough 
water to form a paste or a lotion. Wet packs of boric acid are 
helpful in case of severely poisoned eyelids and swollen eyes. 
Calamine lotion can be used to soothe the discomfort of 
itching, burning skin. Preparations containing iron salts 
are likely to cause permanent UttooeffecU, especially if skin 
in the area of application is broken. 



16. 



QUESTION A RESPONSE MOHE 

Which of the following is essential to avoid ivy 

dermatitis once a person is exposed to poison ivy? 

O Cut down the ivy plant. 

CZ> Do not scratch the affected areas. 

CD Put calamine lotion on the affected areas. 

< ^> Put iron salt solution on the exposed areas. 

*s» Wash all exposed areas wi thing about five 

minutes of exposure. 
CZ> I don't know. 

Which of the following will soothe the itching from ivy 
poisoning? 

CZZ> Cut down the ivy plant. 

CZ> Do not scratch the affected areas. 

4s> Put calamine lotion on the affected areas. 

CZ> Put iron salt solution on the exposed areas. 

O Wash all exposed areas withing about five 

minutes of exposure. 
CZ> I don't know. 

What should you do if the ivy poisoning affects your 
eyelids? 

CZ> Apply calamine lotion. 

<Z> Apply iron salt solution. 

<Z> Apply mild soap solution. 

4s* Apply wet packs of boric acid solution. 

<Z> Apply a paste ofnaking soda and cornstarch. 

CZ> I don't know. 



Outcomes by Age & Approximate School Grades 



Age: 9 


13 


17 


adult 


Grade: 3 


7 


12 




Percent Correct: 








14. 41 


77 


85 


88 


15. 33 


79 


85 


92 


16. 21 


65 


76 


86 
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ITEM 17: NAEP Theme: 



Reading for Significant Facts 

C. Understanding Relationships, Knowing Facts. 



display 

Read the passage and answer the question which follows it. 

One spring Farmer Brown had an unusually good 
field of wheat. Whenever hesaw any birds in the field, he got 
hit gun and shot as many of them as he could. In the middle 
of the summer he found that his wheat was being ruined by 
insects. With no birds to feed on them, the insects had 
multiplied very fast. What Fanner Brown did not under- 
stand was this: A bird is not simply an animal that eats food 
the farmer may want for himself. Instead, it is one of many 
links in the complex surroundings, oranyjniamanL in which 
we live. 

How much grain a farmer can raise on an acre of 
ground depends on many factors. All of these factors can be 
divided into two big groups. Such things as the richness of 
the soil, the amount of rainfall, the amount of sunlight, and 
the temperature belong together in one of these groups. This 
group may fr» nonliving fa**™* The second group 
may be called 1ivi«f facta™ . The living factors in any plant's 
environment are animals and other plants. Wheat, for 
example, may be damaged by wheat rust, a tiny plant that 
feeds on wheat; or it may be eaten by plant-eating animals 
such as birds or grasshoppers. 

It is easy to see that the relations of plants and 
animals to their environment are very complex, and that any 
change in the environment is likely to bring about a whole 
series of changes. 



QTTESTTON & RESPONSE MODE 

17. The passage also points out the importance of which 
fact? 

d> A bird is simply an animal that eats up 
grain. 

<Z> Wheat rust is similar to the rust on your 
own bicycle. 

CZ> Only living factors determine how much 

com can be raised. 
CZ> How much wheat is grown depends only on 

how much is planted. 
^s> Any change in the environment is likely to 

cause other changes. 
CZ> I don't know. 



Outcomes by 

Age & Approximate School Grades 






Age: 9 13 
Grade: 3 7 


17 
12 


adult 


Percent Correct: 

17. 25 69 


82 


89 



Source: National Assessment of Educational Progress. 
(1973, July). Reading: Reading Exercises, Report 02-R-20. 
Washington, DC: U.S. Government Printing Office, (p.54) 



ITEM 18: NAEP Theme: 



DISPLAY 



Following Written Directions 

B. Understanding Written Directions. 



Here is a recipe for making muffins. Read the recipe 
and answer the question which follows it. 

ENGLISH MUFFINS 

1 package active dry yeast 
1/2 cup warm water 

1 1/2 cups milk, scalded 

2 tablespoons sugar 
2 teaspoons salt 
1/4 cup shortening 

5 3/4 to 6 cups sifted all-purpose flour 

Soften yeast in water. Combine next 4 ingredients; 
cool to lukewarm. Stir in 2 cupsjlour; beat well. Add yeast; 
mix. Add enough of remaining flour to make a moderately 
stiff dough. Turn out on a lightly floured surface; knead till 
smooth (8 to 10 minutes). Place in lightly greased bowl, 
turning dough once. Cover, let rise till doubled 1/4 hours). 

Punch down; cover and let rest 10 minutes. Roll to 
slightly less than 1/2 in thick on lightly floured surface. Cut 
with a 3-inch round cutter. (Reroll edges.) Cover and let rise 
till very light ( 1 1/4 hours). Bake on top of range on medium 
hot greased griddle, turn frequently till done, about 30 
minutes. Cool thoroughly. Split with a fork, toast on both 
sides. Serve at once. Makes 2 down. 



QUESTION & RESPONSE MODE 

18. How long does it take to bake English muffins on top 
of range? 

CZ> 8-10 minutes 
<ZZ> Exactly 10 minutes 
^ew About 30 minutes 
<ZZ> 1 1/4 hours 
CZ> More than 3 hours 
I don't know. 



Outcomes by 

Age k Approximate School Grades 






Age: 9 13 
Grade: 3 7 


17 
12 


adult 


Percent Correct: 

18. 36 66 


65 


86 



Source: National Aeeestment of Educational Progress. 
(1973, July). Raadinr Raadinf Exercises, Report 02-R-20. 
Washington, DC: U.S. Government Printing Office (p.21) 
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Figure 27 



NAEP 1973 Assessment Items 



ITEM 19: NAEP Theme: 



DISPLAY 



Following Written Directions 

A. Understanding Written Directions. 



QtTESTION & RESPONSE MODE 



Read the passage and answer the question which follows it. 

One spring Farmer Brown had an unusally good field 
of wheat. Whenever he saw any birds in the field, he got his 
gun and shot as many of them as he could. In the middle of 
the summer he found that his wheat was being ruined by 
insects. With no birds to feed on them, the insects had 
multiplied very fast. What Farmer Brown did not understand 
was this: A bird is not simply an animal that aats food the 
farmer may want for himself. Instead, it is one of many links 
in the complex surroundings, or »nvtmnm>wt in which we 
live. 

How much grain a fanner can raise on an acre of 
ground depends on many factors. All of these factors can be 
divided into two big groups. Such things as the richness of 
the soil, the amount of rainfall, the amount of sunlight, and 
the temperature belong together in one of these groups. This 
group may be called tmn.itviny fkrt^n The second group 
may be called liyjngfacloia. The living factors in any plant's 
environment are animals and other plants. Wheat, for 
example, may be damaged by wheat rust, a tiny plant that 
feeds on wheat; or it may be eaten by plant-eating animals 
such as birds or grasshoppers . . . 

It is easy to see that the realtions of plants and 
animals to their environment are very complex, and that any 
change in the environment is likely to bring about a whole 
series of changes. 



19. What is the MAIN idea of this passage? 

CD Farmers should not shoot any birds. 

CD Insects eat up all the farmer s crops. 

CD Birds eat up most of tha farmer's grain. 

CD No crops can be grown without sunlight. 

4B» All living things are affected by living 

things. 

CD 1 don't know. 



Outcomes by 

Age ft Approximate School Grades 






Age: 9 13 
Grade: 3 7 


17 
12 


adult 


Percent Correct: 

19. 25 69 


82 


89 



Source: National Assessment of Educational Progress. 
(1973, July). Reading: Reading Exercises, Report 02-R-20. 
Washington, DC: U.S. Government Printing Office, (p.54) 



ITEM 20: NAEP Theme: Following Written Directions 

B. Understanding Written Directions. 



DISELAX 

Read the passage and complete the sentence which follows. 

Skiing has recently become one of the more popular 
sports in the United States. Because of its popularity, 
thousands of win ter vacationers are flying north rather than 
south. In many areas, reservations are required months 
ahead of time. 

I discovered the accommodation shortage through an 
unfortunate experience. On a sunny Saturday morning I set 
out from Denver for the beckoning slopes of Aspen, Colorado. 
After passing signs for other ski areas, I finally reached my 
destination. Naturally I lost no time in heading for the tow. 
After a stimulating afternoon of miscalculated stem turns I 
was famished. Well, one thing led to another and it must 
have been eight o'clock before I concerned myself with a bed 
for my bruised and aching bones. 

It took precisely one phone call to ascertain tha lack 
of lodgings in the Aspen area. I had but one recourse. My 
auto and I started the treacherous jaunt over the pass and 
back towards Denver. Along the way, I went begging for a 
bed. Finally a Jolly tavernkeeper took pity and for only thirty 
dollars a night allowed me the privilege of staying in a 
musty, dirty, bathless room above his tavern. 



QUESTION & RESPONSE MODE 
20. The authors problem would have been avoided if he 



had 




CD 


not tired himself out skiing. 


CD 


taken a bus instead of driving. 


CD 


. looked for food as soon as he arrived. 




arranged for accommodations well ahead 




of his trip. 


CD 


I don't know. 



Outcomes by 

Age Is Approximate School Grades 

Age: 9 13 17 adult 

Grade: 3 7 12 

Percent Correct: 

20. 32 77 91 93 



Source: National Assessment of Educational Progress. 
(1973, July). Reading: Reading Exercises, Report 02-R-20, 
Washington, DC: U.S. Government Printing Office, (p.63) 
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ITEM 21: NAEP Theme: 



DISPLAY 



Following Written Directions 

A- Understanding Written Directions. 




Source: National Assessment of Educational Progress. 
(1973, July). Reading: Reading Exercises, Report 02-R-20. 
Washington, DC: U.S. Government Printing Office, (p.85) 



fiUESPQM * RESPONSE MODE 
21. Where would you probably see this sign? 

40* On the highway 

CZZ> On a gymnasium floor 

CZ> At a racetrack for horses 

O In a grocery store 

CZ^> I don't know. 



Outcomes by 

Age & Approximate School Grades 



Age: 
Grade: 



Percent Correct: 
21. 23 



13 

7 



45 



17 
12 



76 



adult 



88 
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Figure 29 



NAEP 1973 Assessment Survey 



100 



White-American 



Black-American 



100 




Listening Speaking | Listening & Reading I Reading 

Listening & Reading TV Guide j Directions j 

Dictionary / Using Alphabet Index Reading for Facts Reading & Infer. 

Performance of White and Black American adults (26-35 years old ) on 21 items 
from the 1971 National Assessment of Educational Progress. 

Source: National Assessment of Educational Progress. (1973, July). Reading: Reading Exercises, Report 02-R-20. 
Washington, DC: U.S. Government Printing Office. 
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Louis Harris and Associates 
"Survival Literacy" Study - 1970 

In 1970 the Louis Harris polling organization sur- 
veyed adults chosen to represent a cross section of 
the overall population* Those interviewed were asked 
to fill out five common application forms. 

Figure 30 summarizes data averaged over all five 
forms. The data show the percentage who scored 70 
percent correct or better, 80 percent correct or better, 
and 90 percent correct or better* Because 70 percent 
correct is a lower criterion, more people score at that 
level and above than at the more demanding criterion 



of 90 percent and above.Thus, whereas 92 percent of 
adults with 8th grade education or less scored 70 
percent or better, only 76 percent scored 90 percent 
or better correct. 

Figures 31 and 32 show two of the forms and the 
responses in percent correct for adults having three 
levels of education* As indicated in figure 32, the 
Medicaid form was particularly difficult, with only 
54 percent of those with an 8th grade education or 
less getting 90-100 percent correct* Even many 
college educated adults had trouble compJ :aig the 
Medicaid form* 



Figure 30 Harris and Associates Survival Literacy Study - 1970 
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Source: Conpeeeknei Heart. November It. 1970. P*e E972Z Chert XVUI 
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Figure 31 Harris and Associates Survival Literacy Study - 1970 



1. 

2. 
3. 
4. 
5. 

6. 
7. 



Form III 
Application for Driver's License 
What is your name? 



What is your weight?. 
What is your height? . 



feet,. 



inches 



What is the color of your eyes? . 



9. 



List any visual, physical, or mental conditions that might 
impair your ability to drive safely ? 



list any previous driver's license issued to you: 
State Year 

How many times have you previously been examined for 
driver's license? 

What day of the week would be most convenient for you to 
take the driver's examination? 

What hour of the day would be most convenient for you to 
take the driver's examination? 



PLEASE MAKE SURE ALL QUESTIONS HAVE BEEN ANSWERED. IF YOU ARE NOT 
SURE OF AN ANSWER TO ANY ITEM, DRAW A LINE THROUGH THE SPACE PROVIDED 
FOR THE ANSWER. 



( N.B. Drawing a line through the space was consider a correct answer. ) 

Source: LCS<e>d^andCT.Kic^(19^ 
SHI* IMOto 1910. Madiioii.WI:Wiiconmaa^ 



Years of Education 



Percent Correct 8th grade High 
Score Range or less School College 



90 • 100 

80*89 

70-79 



83 a 
9 
4 



92 
5 
2 



96 
2 
1 



a 



Percentage of respondents falling in the given percent correct score range 



Source: ConcreuioMl Record* November It, 197a P*e £9722. Qm XVQI. 
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Figure 32 I Harris and Associates Survival Literacy Study - 197p" 



Fonn V, Application for Medicaid 
A. Person applying for medical assistance: 



B. 



D. 



(LAST NAME) 
Address: 



(FIRST NAME) 



(INITIAL) 



Do you earn a salary or wage? 
If employed, write below: 
Employer's name and address: 
Total wages or income: 



Are you self-employed? . 



per (week, month, etc.) 



How many hor^rs per week are you usually employed? 



Is any payment for room and board or other contribution received from any 

other person who resides in the household? 

If another person paying, answer the following: 

Name of person making payment or contribution: 

Amount paid: per (week, month, etc.) 



Do you have cash savings or other liquid assets such as savings accounts, 
savings bonds, stocks, bonds, etc., or any claim pending for personal injury, 

disease, or disability? 

If you have cash or other savings, answer the following: 

Types of assets: . 

Name of bank, company invested in: 

Type of policy: 

( INDICATE WHETHER WHOLE LIFE, 20 PAYMENT LIFE, 20-YEAR 
ENDOWMENT, TERM INSURANCE, FAMILY PLAN, ETC. ) 

Do you expect to incur any medical expenses withing the next three 
months? 

If yes, what type of medical service is required? 

Estimated cost: 



G. Do v v have any physical or mental handicap or disability? 

If >\,a have handicap or disability, write below: 

Description of handicap or disability: 

Date started: 

PLEASE MAKE SURE ALL QUESTIONS HAVE BEEN ANSWERED. IF YOU ARE NOT SURE OF AN 
ANSWER TO ANY ITEM, DRAW A LINE THROUGH THE SPACE PROVIDED FOR THE ANSWER 



( N.B. Drawing a line through the space was consider a correct answer. ) 

Source: DJLH*er(197S.JttNiy). Functional ttancy and the achate. Washington, DC: 
U.S. Department of HcaJdx Education and Welfare, National taatttj* of Education, p. 42. 







Years of Education 




Percent Correct 


8th grade 


High 


College 


Score Range 


or less 


School 


90 - 100 


54 a 


66 


74 


80-89 


17 


17 


16 


70-79 


9 


9 


6 


Percentage of respondents falling in the given percent correct score range 



Source: ConpeuioMl Record. November IS. 1970. Pas* E972Z Chut XV tn. 
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Adult Functional Reading Study - 1973 

The first part of the Adult Functional Reading Study 
conducted household interviews to determine what 
kinds of literacy practices engage adults. In the 
secondpart of the study literacy tasks were developed 
and administered to assess the literacy skills of a 
second household sample. Data from the two parts of 
the study ait summarized in Figure33. 

Though 170 items were administered in the study, 
only five items were released to the public. The data 
for literacy skills based solely on the five items are 
presented Figure 33. The five items themselves are 
given in Figures 34, 35, and 36. Over all 170 items, 



over 70 percent of the respondents scored 70 percent 
correct or better. As a trend, better educated adults 
performed better on the test than less well educated 
adults, and whites tended to perform better than 
blacks. 

As with Busweirs (p. 43) study, both literacy skills 
and literacy practices are seen to increase asafunction 
of extent of education. Book and magazine reading 
were more highly related io years of education than 
was newspaper reading. Altogether, the adults re- 
ported that they spent about 90 minutes a day in 
reading one or another type of materials (including 
such things as forms, labels, signs, bills, mail, etc.). 



Figure 33 



Adult Functional Reading Study - 1973 



0-8 



Literac y Skill 



Literacy Practice 




0-12 13.16 
Years of Education 



16+ 



0*8 



16+ 



9*12 13-16 

Year* of Education 

• Read newspaper 
"Q" w Read a book 

Read news and/or general magazines 



Source: R.T. Murphy (1975). Assessment of Adult Reading 
Competence: D. Nielsen end H. Hjelm (Eds.). Reeding and Career 
Education. Newark, DE: International Reeding Association. Data 
presented are from table 3 and are averages for the five items at each 
education level in the table (p 57). 



Source: R.T. Murphy (1973. December). Adult Functional Reading 
Study. Appendix A. Report PR 73-4*. Princeton, NJ: Educational 
Testing Service, p. 1. table 2.2. Data for magazines is the average 
for news and general magazines reported in table 2.2. 
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Figure 34 



AFRS • Test Items 



Item 1: Oral Directions: Place a circle around the bottle of liquid that would be safe to drink. 




Years of Education 0 • 8 

I L_ 

Percent Correct 99.3 



9-12 
1 



100 



13- 15 
I 



100 



16 + 
_l 

100 



Source: R.T. Murphy (1975). AMessroent of Adult Reading Competence: D. Nielsen and H. H elm (Eds.). Reading and Career Education. 
Newark, DE: International Reading Association, (p. 57). 



Item 2: Oral Directions: Place a circle around the label that would be the best one to put on a box used to mail 

something easily broken. 



PERISHABLE - KEEP REFRIGERATED 



THIS END UP 



CONFIDENTIAL 



SPECIAL DELIVERY 



FRAGILE • HANDLE WITH CARE 



AIR PARCEL POST 



Years of Education 0-8 

I l_ 

Percent Correct 83.1 



9-12 
_J 



13-15 
I 



16 + 



98.5 



99.3 



97.5 



Source: R.T Murphy ( 1975). Assessment of Adult Reading Competence: D. Nielsen and H. Hjelm (Eds.). Reading and Career Education. 
Newark. DE: International Reading Association, (p. 58). 
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Figure 35 



APRS - Test Items 



Item 3: Oral Directions: Look at the application for employment. Put an X in the space where you 

would write the name of someone to notify in case of emergency. 
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Years of Education 0-8 9-12 13-15 16 + 

I I I I I I I I 

Percent Correct 773 95.3 97.9 99.0 

Source: R.T. Murphy (1975). Assessment of Adult Reading Competence: D. Nielsen and H. Hjelm (Eds.). Reading and Career 
Education. Newark, DE: International Reading Association, (p. 58). 



Item 4: Oral Directions: 



Look at the garment tags. Circle the two tags that indicate the garments are made 
from 100% Polyester. 



100% ARNZl+TtUACETATE 
ARNEl?ta • Itcasst* trassmsrk 
witch can »t *m* to Mssttfy 
Celassst Tnacstst* Fiber* only 

IS f SOClCS Of STOVOS SCrfOTfltftOCS- 

Catassss lasoratortos costlasaUy 
svalsast fatrtca of tko aamo stylo 
ss in tills gftrmow agataat rigores* 
aarf oosaa cs ataasaras- if tut US* 
rie stylos foil to most rhtst ataa- 
Ssrss. tot Triscotsto ftssra esssot 
st ttsmtf too ss ARNEL- 



•MscMso waak * fsstls cyclo - 
worm wfttftr. 

•TvmstoSry. wim setttsg. 
•Stssm itm st stadium acmsc . 
•Wash dark colors or prima 
ssssratsly. 

•Wftok sisssji flsrmsts ay teas* - 
drtt) Sry • sjo sot vnsg. 
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DRY-CLEAN A1LE 




SUGGESTED RETAIL FRICR 




111.00 



WASMNG INSTRUCT*** 

Wssh sy mscMnt st low ttmstrstsrs. Dry 
by maditao st low tomstrsturs or kaag on 
line- If trasisg Is sssirsS. ost eosl iron only. 

ADVANTAGES: 

1. . Smo o t h comfort, toaal for astsrwssr or 
son to skis. 

2. gseo l lsst Sa nmi aail stsstllty. 

3. Orltfteftfl wtrmtti wick llfta watgM- 
4* Btsyesrs. saetth 
S. 



Tss trrsfsUrtttos as* vsristlsss Is tsa 
wasao of tost fssric srs caaractsriattca 
sf tWs taartc aaC art si so way 
toba« 



•027 SIZE * 
«E ACETATE 
35* FORTREL 



MACHME WASH 
FRESS ON 
WRONG SIDE 
WITH COOL IRON 

f o mm 

WPL »3II 



D 



100% TEXTURED FOLY ESTER 

•Mac*** Was* ass Ory-Waah asS waar eyela 
•Will Nat Skrtak or ttrstch 
•Wriskta Rasiitr.s 
•NEEDS NO IRONHO 
♦00 NOT DRY CLEAN 
FALtSADE XNITT1NC MILLS. CUTTENtERG. N-J. 



Years of Education 0-8 9-12 13-15 16 + 
I I I I I I I I 

Percent Correct 66.6 82.4 90.4 91.4 

Source: R.T. Murphy (1975). Assessment of Adult Reading Competence: D. Nielsen and H. Hjelm (Eds.). Reading and Career Education. 
Newark, DE: International Reading Association, (p. 59). 
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Figure 36 



AFRS - Test Items 



Item 5: Oral Directions: Look at the train schedules. Put a circle around the time the daily train leaving Trenton at 

1 :46 p.m. arrrives in Washington. 
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Years of Education 



0-8 
I 



9-12 



13-15 
I 



Percent Correct 



40.1 



68.7 



76.5 



16 + 
_J 



80.1 



Source: R.T. Murphy (1975). Assessment of Adult Reading Competence: D. Nielsen and H. Hjetm (Eds.). Reading and Career 
Education. Newark. DE: International Reading Association, (p. 60). 
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The Adult Performance Level Study 

The Adult Performance Levd ( APL) study began in 
1971 as a project funded by the U. S. Office of 
Education. It introduced the concept of "compe- 
tency-based" education to the field of adult basic 
education. The term "competency-based" meant that 
adult basic education was to be focussed on achieving 
measurable outcomes. By 1977, when the project 
was completed, two-thirds of the states had imple- 
mented some form of "competency-based" adult 
basic education. An overview and critique of the 
APL project is presented by Fischer, Haney and 
David (1980). 

Test items that were included in the final (unpub- 
lished) report of the APL project are reproduced on 
pages 68 through 97. Each item shows what the 
examiner said and what the respondent did. For 
instance, in Figure 38, Item 1 , the examiner gave the 
respondent a card with a sign on it about the ABC 
Company. The examiner says, orally, "Here's a 



notice that's on a company bulletin board. Please 
read the notice to me." The respondent then reads the 
sign out loud , This procedure is followed on each 
item. That is, the instructions are given orally, and 
the respondent looks at and reads some information 
display and makes a response. 

For each item, information is given showing the 
national average percent getting the item correct, 
and then the average percent correct obtained by 
adults with different years of education. Figure 37, 
below, presents the average percent correct scores 
over all items for adults at the different levels of 
education. 

Reference 

Joan Fischer, Walt Haney, & Lloyd David (Septem- 
ber, 1980). APL Revisited: Its Uses and Adaptation 
in States. Washington, DC: National Institute of 
Education, Office of Educational Research and 
Improvement, U. S. Department of Education. 
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Adult Performance Level Study (Literacy Skill) 
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Source: The Adult Performance /* 
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Level Study: A report submitted to u 
the Office of Education Dissemination 
Review Panel." Undated but labelled 
in handwriting "O.K. 3/25/75." 


8 less H.S. Some College 
or less than 12 Grad. College Graduate 

Years of Education 
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Figure 38 



APL - Test Items 



ITEM 1: Part 1. Examiner says: 

"Here's a notice that's on a company bulletin board. Please read the notice to me." 



ABC 
COMPANY 
We are an Equal 
Opportunity Employer 



Years of Education 



Percent Correct: 



National 
Average 

I 

93 



8 years 
or less 



less than 
12 years 



High School 
Graduate 



Some 
College 



i — 
78 



i 

93 



i 

95 



98 



College 
Graduate 



98 



ITEM 1: Part 2. Examiner says, as respondent reads along: 



"This notice means: 


1 


all people working in the firm are given 




equal consideration 


2 


discrimination has not occurred within the 




firm 


3 


you don't have to meet job requirements in 




order to apply for that job 


* 4 


employment applications will be considered 




without regard to race, creed, sex, or 




national origin/* 



Years of Education 



National 8 years less than High School Some College 

Average or less 12 years Graduate College Graduate 

I i 1 1 1 1 

Percent Correct: 80 57 72 85 90 90 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Diuemi nation Review Panel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL • Test Items 



ITEM 2: Examiner says: "Look at the notice that is posted at the cashier's desk in a store. 



Check Cashing 



s 


.01 ■ 


• $ 


10.00 


Charge of $ .15 


s 


10.01 


• $ 


50.00 


Charge of $.20 


$ 


50.01 


- $ 


75.00 


Charge of $.25 


$ 


75.01 


- $ 


100.00 


Charge of $.30 



No checks over $100.00 cashed 
No 2-party checks 



"The notice means that if someone writes you a check for $120.00, the store will cash it: 

1 for 300 

2 for a special price 

* 3 under oa circumstances 
4 if you buy something." 



Years of Education 



Percent Correct: 



National 
Average 

I 

77 



8 years 
or less 



less than 
12 years 



High School 
Graduate 



54 



— r~ 
70 



Some 
College 
1 



88 



Years of Education 



Percent Correct: 



National 
Average 

I 

88 



College 
Graduate 

1 

93 



ITEM 3; Examiner says: "According to the Constitution, permission to have peaceful 

public meetings should be given to: 

* 1 all groups 

2 most groups* if they are not too radical 

3 a few groups that will not cause trouble 

4 government approved groups only." 



8 years less than High School Some College 
or less 12 years Graduate College Graduate 

i 1 1 1 i 

76 86 89 94 93 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel.' 
Undated but labelled in handwriting "O.K. 3/2V75." 
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Figure 40 



APL - Test Items 



ITEM 4: Examiner says: 



"Jean Rankin is going to buy a pair of shoes today at the Justin Shoe Store. The cost of 
the shoes including the sales tax is $8.16. She is going to pay for the shoes with a check. 
Fill out the sample check as Jean Rankin would." 



lc 



no. 139 



.19 

.$ 



. Dollars 



THE FIRST NATIONAL BANK 
OF PRINCETON 
mttemm.iL j. 

••:0 3i2«*030si: 



Years of Education 

National 8 years less than High School Some College 
Average or less 12 years Graduate College Graduate 

' 1 1 1 1 1 

Percent Correct: 86 56 85 98 93 94 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 


ITEM 5: Examiner says: "The House of Representatives is going to vote on H.B. 74-89 1 . The Bill will reduce the 

amount of Social Security paid to women over 65. John Frask is against the Bill. Finish this 
letter that he will send to his U.S. Representative, whose name is Henry Sanchez." 






Henry Sanchez 
U.S. Representative 
House of Representatives 
Washington, D.C. 


321 Sunshine Street 
Boulder, Colorado 62510 
November 26, 1973 








Dear Mr. Sanchez: 










Very soon the House of Representatives will vote 








on ( Correct response: H. B. 74-891 ) 








I am strongly opposed to this bill; therefore, 








I urge vou to ( Correct response: vote aqainst) . 










Sincerely yours, 

John Frask 

John Frask 










Years of Education 




Percent National 8 years 
Correctly Entering Average or less 


less than High School Some College 
12 years Graduate College Graduate 


1 ■ 

"H.B. 74-891": 87 58 
"vote against": 80 57 


i i i 
85 92 96 
74 84 89 


97 
93 


Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel/ 
Undated but labelled in handwriting "O.K. 3/25/75." 
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Figure 42 


APL - Test Items 


ITEM 6: Examiner says: 


"Pretend that you are Jack Youngtree. You live at 444 Dogwood Lane, Apple Blossom, 
Vermont, 051 1 1. You want to write a letter to Mr. Sam Wood, editor of the Blahtown 
Daily News in Blahtown, Vermont, 051 12. 






Address the envelope for Jack." 








w 








Years of Education 




Percent 

Correctly Entering 


National 8 years lersthan High School Some College 
Average or less 12 years Graduate College Graduate 


"Return Address": 
"Addressee's Address' 


1 i r 1 1 — i 

76 42 75 82 85 85 

87 56 86 93 96 96 


Source: 


"The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL • Test Items 



ITEM 7s Examiner says: 



"Swimming lessons offered at the YWCA cost S 100 for a six-week course for the first 
child and $75 for each additional child in the same family. Mrs. Hare has 5 children 
and wants all of them to take the lessons. How much will she have to pay?" 
(Correct response: $400). 



Note: Respondent reads along with examiner and can refer to written display. 



Years of Education 



Percent Correct: 



National 
Average 

t 

79 



8 years 
or less 



less than 
12 years 



High School 
Graduate 



53 



74 



i 

84 



Some 
College 

1 

87 



College 
Graduate 



— i 
93 



ITEM 8: Examiner says: "Joe is 45 years old, is married, and has three children to support Which 

job characteristic would Joe be most attracted to?" 

1 high commissions 

2 little experience required 

3 group medical plan offered 
* 4 good job security 

Note: Respondent reads along with examiner and can refer to written display. 

Years of Education 



Percent Correct: 



National 
Average 

! 

82 



8 years 
or less 



less than 
12 years 



High School 
Graduate 



Some 
College 



College 
Graduate 



73 



80 



i 

83 



t — 
86 



— i 
91 



Sauce: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel/ 
Undated but labelled in handwritm* "O.K. 3/25/75." 
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Figure 44 



APL - Test Items 



ITEM 9: Examiner says: "Information about Mr. Reed's insurance policy is shown below 

If Mr. Reed is admitted to a Non-member Hospital as a bedpatient, how much of the 
cost will he have to pay himself?" (Correct response: 25%). 



Non-member Hospital Benefits 

When any participant is admitted as a bedpatient in a Non- 
member Hospital, this insurance will provide benefits equal to 
75% of the total value of the benefits which would have 
accrued if the same care had been furnished by a Member 
Hospital. For out-patient care, the benefits are the same as in 
a Member Hospital. 



Percent Correct: 



National 
Average 

I 

73 



8 years 
or less 



49 



Years of Education 



less than 
12 years 



High School 
Graduate 



i 

66 



! 

80 



Some 
College 

1 

80 



College 
Graduate 



— i 
79 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Pine!/ 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 10; Examiner says: 



"Mr. King wants to go from Wood Lake to Brewster. He is a stranger to Nebraska and he 
wants to take the most direct route. Name the town where he has to change from one 
highway to another." (Correct response: Ainsworth) 




Years of Education 



Percent Correct: 



National 
Average 

I 

86 



8 years 
or less 



less than 
12 years 



High School 
Graduate 



Some 
College 



i 

64 



I 

82 



i 

90 



I 

93 



College 
Graduate 

1 

% 



Source: The Adult Performance Level Study: A report submitted to the Office of Education Dtueminatioo Review Panel.' 
Undated but labelled in handwriting "O.K. 3/25/75." 
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Figure 46 


APL - Test Items 






ITEM IX: Examiner says: "Police have the authority to detain a person for as long as a week while deciding whether 

or not to bring charges against him 


1 

1 






1 when they think it will produce a confession 








2 when dealing with severe crimes 


1 






* 3 under no circumstances 








4 when dealing with a previous offender." 


1 




Years of Education 

National 8 years less than High School Some College 
Average or less 12 years Graduate College Graduate 

1 J I 7 1 \ 

Percent Correct: 66 47 56 69 77 80 






ITEM 12: Examiner says: "Upton Sinclair's novel The Jungle exposed the unsanitary and unhealthful conditions in the 

meat packing industry. The public reaction to this scandal led to: 


■ 
1 






1 a meat boycott 








2 censorship of his book 


1 






3 the President's resignation 








* 4 the first food and drug legislation." 


J 




Years of Education 

National 8 yean less than High School Some College 
Average or less 12 years Graduate College Graduate 
1 i i i i i 
Percent Correct: 75 55 71 76 85 91 


1 




Source: 


The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel.** 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 


ITEM 13: Examiner says, as respondent reads along: 

"Manuel makes $2.00 an hour and works a 40-hour week. He is paid time and a half for 
overtime. How much would he earn if he worked 43 hours one week?" 
(Correct response: $89.00) 




Years of Education 






National 8 years less than High School Some 
Average or less 12 years Graduate College 


College 
Graduate 


Percent Correct: 71 58 65 72 77 


86 


ITEM 14: Examiner says, as respondent reads along: 

"It is tiie beginning of a new year. Mary Percy has decided that this year she is going to save 
the records that are needed for income tax purposes. Which one of the following items 
should she keep, assuming that there is not state sales tax? 




* 1 receipt from B J. Smith, Mi. 






2 receipt for car safety equipment required by federal government 






3 sales tag from a winter coat 






4 cancelled check paid to a local supermarket or grocery store." 






Years of Education 






National 8 years less than High School Some 
Average or less 1 2 years Graduate College 


College 
Graduate 


Percent Correct: 81 69 77 83 83 


1 

89 


ITEM 15: Examiner says, as respondent teads along: 

"Mr. Threadgill is having his yearly physical check-up. The nurse says his temperature is 
normal. What is the normal human temperature?" 
(Correct response: 98.6) 




Years of Education 






National 8 years less than High School Some 
Average or less 1 2 years Graduate College 


College 
Graduate 


Percent Correct: 73 50 66 77 82 


86 


Source: 


The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated but labelled in handwriting "O.K. 3/2 V75." 
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APL - Test Items 



ITEM 16: Examiner says, as respondent reads along: 

"Look at the Earnings Statement and answer the questions/' 



Examiner 

Does 

Not 

Read 

These 

To 

Respondent 



Parti. 



Part 2. 



Part 3. 



Altogether, how much money was deducted from Walter Johnston's pay? 
(Correct response: $111.11) 

How much of his pay was deducted for income tax? 
(Correct response: $39.83) 

How much was deducted for social security?" 
(Correct response: $21.48) 



The University of Texas at Austin 

EARNINGS STATEMENT 



rr I L15094! 01933 9 I 26-4212-S610 



03/31/ »97: 



000669 




PLEASE CHECK YOUR SOCIAL SECURITY NUMBER FOR ACCURACY* 



WALTER L. JOHNSTON, JR. 
rr UNIVERSITY STATE BANK - EEP0SIT 
r AUSTIN, TEXAS 

L. i r 



II 




4S3-94-33S 


MM jam 

►1 [a! 


CMUWUtT 

413.25 


59.83 


21.48 ! 29.80 


0.00 


0.00 


0.00 


0.99 




0.0 

1 mHM ' 


0* 00 




302.14 



NON-NEGOTIABLE - RETAIN FOR YOUR RECORDS 



Percent 
Correct: 



Years of Education 





National 


8 years 


less than 


High School 


Some 


College 




Average 


or less 


12 years 


Graduate 


College 


Graduate 


Part 1. 


1 

83 


i - 
63 


i 

80 


i 

87 


i 

88 


i 

93 


Part 2. 


91 


77 


90 


94 


95 


% 


Part 3. 


74 


65 


70 


75 


76 


84 



Source: The Adttt Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated bat labelled in handwriting "O.K. 3/25/75." 
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ITEM 17: Examiner says, as respondent reads along: 

"Below are three boxes of cereal. On each box is printed the price and the weight. Look at 
the prices and weights and then answer the two questions below. 

Part i. Which one of the three boxes of cereal contains the most cereal by weight? 
(Correct response: second) 

Part 2. Which one of the three boxes of cereal is the best buy?" 
(Correct response: second) 



89* 

EI Grosso 
Cereal 

17oz. 

Net Weight 



91* 



Soggy 

Woggies 

Cereal 



19oz. 

Net Weight 



91* 



Frasbee Oat 
Cereal 

18oz. Net Weight 



Years of Education 



National 8 years less than High School Some College 

Average or less 12 years Graduate College Graduate 

Percent | , , , , , 

Correct: Parti. 96 88 96 97 97 99 

Part 2. 74 65 68 76 79 81 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 18: Examiner says, as respondent reads along: 

"Here is a graph showing the effectiveness of two brands of a common pain reliever. 
Which brand is more effective after 25 minutes?" 
(Correct response: both, neither, no difference, same) 



t 



Level of 
Concentration 
in Blood 



LEVEL OF EFFECTIVENESS 




BRAND A 



10 



15 

MINUTES 



20 



25 



Years of Education 



Percent Correct: 



National 
Average 

I 

67 



8 years 
or less 

i 

41 



less than 
12 years 

1 

62 



High School 
Graduate 



Some 
College 



College 
Graduate 



i 

67 



i 

82 



90 



Source: The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel.' 
Undated but labelled in handwriting "OX 3/25/75." 
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ITEM 19: Examiner says, as respondent reads along: . 

"When Mrs. Garibaldi *ent to the store, she found that tuna, macaroni, peaches, and spinach 
were on sale. If she wants a high protein dinner, which one of these should she buy? 

* 1 tuna 

2 macaroni 

3 peaches 

4 spinach." 



Years of Education 



National 8 years less than High School Some . College 

Average or less 12 years Gra duate College Grad uate 

I 1 1 Jr. X 2a 

Percent Coirect: 71 56 69 69 76 88 



ITEM 20: Examiner says, as respondent reads along: . 

"Mr. Roger's monthly paycheck before deductions is $400.00. Each month, $20.00 is 
deducted for Social Security and $60.00 for withholding tax. How much is his jfcady. take 
home pay?" 

(Correct response: $3840) 

Years of Education 

National 8 years less than High School Some College 
Average or less 12 years Graduate College Grad uate 

Percent Correct: 71 49 61 75 80 86 



Source: "The Adult Perfomwnce Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 21: Examiner says, as respondent reads along: 

'Tim Brown missed a day of school because of a sore throat. 

Write a note to his teacher, Mrs. Drake, asking that Tim's absence be excused." 



Parti: 


Salutation 


Part 2: 


Message 


Part 3: 


Who is excused 


Part 4: 


Signature 



Years of Education 



Percent 




National 
Average 

1 


8 years 
or less 


less than 
12 years 


High School 
Graduate 


Some 
College 


College 
Graduate 


Correct: 


Part I. 


78 


i 

56 


i 

80 


i 

81 


85 


- i 
87 




Part 2. 


93 


77 


95 


96 


97 


97 




Part 3. 


93 


75 


95 


97 


96 


97 




Part 4. 


71 


51 


71 


74 


78 


79 



"The Aduit Perfomwnce Level Study: A report submitted to the Office of Education Dissemination Review Panel " 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 22: Examiner says, as xtsy ;v dent reads along: 

"You are Jane D. Hughes and you are applying for a social security number for the first 
time. You are 18 years old. Your mother's maiden name was Mary Jane Davidson and your 
father is John Blair Diamond. Fill out the missing information on the form." 



Score 4 Pans: 

1. Applicant's Name 



2. Applicant's Age 3. Mother's Name 4. Father's Name 



ID CN DO 

APPLICATION FOR A SOCIAL SECURITY NUMBER B34 



oo not wmrm m mt amvi s»ac« • 



fijtf fWtt NAMC 



"CL VU M VOW 

t tmwtf ( Pari l; Score: Applicant's Name ) 

Sir nit 

MMtttVfN 



(Part3: Score: Mother's Name ) 




Jane Diamond 



Somerset 



f ATHtrt PULL MAM Wif »i tWi 

(Part 4: Score: Father's Name ) 



MM T«# IVt« MPM| Amill 



Tft* X t^W, M>. P.O. ImrlWlWl) 

[EK&A A/orfh Post St. 




f Parti: 
Score: Age ) 



Madison Illinois 6fTgg 

NOTICI: •<* » Mil* Ms •» nmm» «tof • *» *«Hfy, .ill II, Uri«U« « mm— »E"" 



teciAL Mcwtirr asmwitaatipm o*hci 



Years of Education 



Percent 
Correct: 





National 
Average 
1 


8 years 
or less 


less than 
12 years 


High School 
Graduate 


Some 
College 


Parti. 


83 


i 

56 


80 


1 

89 


i 

90 


Pan 2. 


61 


32 


61 


64 


69 


Part 3. 


88 


61 


90 


92 


95 


Part 4. 


82 


51 


83 


87 


90 



College 
Graduate 



Source: 



-i 
90 
74 
97 
91 



Tie Adult Performance Level Study: A report submitted to the Office of Education Diucminatioo Review Panel." 
Undated but labelled in handwriting "O.K. 3/2V75." 
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APL - Test Items 



ITEM 23: Examiner says, as respondent reads along: 

"What is a credit check? 



1 a check given as a monthly payment 
* 2 a check to see if you pay your bills 

3 a check on your bank account balance 

4 a substitute for money." 

Years of Education 



Percent Correct: 



National 
Average 

I 

74 



8 years less than High School Some College 
or less 12 years Graduate College Graduate 

I 1 ! 1 1 

54 70 77 79 87 



ITEM 24: Examiner says, as respondent reads along: 

Part I . "Mr. Johnston from Austin needs to fly to Kansas City for a noon meeting on Tuesday. 

What flight must he take in order to be there on time?" (Correct response: (22/400) or (7:20am)) 

Part 2. "If his meeting lasts an hour and a half, what is the first flight he can get leaving Kansas 
City for Austin?" (Correct response: (237/125) or (3:05pm)) 



From Austin • 



ftomAu&On- 



<•) indtoftN Non-Stop 



KANSAS CITY 
753-1740 



To Austin 



-ToAumn 



LEAVE ARRIVE FLIGHT 



LEAVE ARRIVE RIGHT 



7:20* 
10:05* 
12:35* 
4:10p 
7:30p 
7:30p 



9:4$A 22/400 

1:42p lit/22* 

4£4p 15<V15* 

7:37p 112/134 



3:05* 
8:10* 
9:15* 
1230P 



10:446 1M/7*(tR S*) 12:40© 



•:57* 
11:52a 
11:52* 
3:17p 
3:17p 
«:47p 
11 :27p 
11:27p 



130/167 
47/1*5 
401/1 65<*l Su) 
141 

155/141 

237/1 25 <«x 5*) 
15*1*7 
30/1*7 <** S*) 




Note: Form shortened from original. 



NEW ORLEANS 
9234011 

FtomAum~ 

LEAVE ARRIVE PLIGHT LEAVE ARRIVE 

7:20* 10:05* 22/197 10*5* 3:17p 

10:09* 12:49* 11*039 3:19* *:47p 

I2:36p 3:39* 150/155 9:49* "37p 

4:10* *20* 112/409 <•**•) 



-ToAu&ltn 

FLIGHT 
132/141 
1*9/125 
7*/1*7<*xS*) 



Years of Education 



Percent 
Correct: 



Parti. 
Part! 



National 
Average 

I 

70 
67 



8 years 
or less 



less than 
12 yean 



High School 
Graduate 



Some 
College 



College 
Graduate 



39 
43 



63 
60 



74 
68 



i 

85 
85 



82 
84 



Source: "The Adah 
Undated bet 



Level Study: A report submtted U> the Office of Education DiteemiMbon Review Panel.' 
in hMdwrtons "O.K. 3/2V75." 
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APL - Test Items 



ITEM 25: Examiner says, as respondent reads along: 

"When a person has the "right of way" in traffic, it means: 

1 he must stay in the right hand lane 

2 he has the right to turn in any direction he chooses 

3 he should use his right turn signal 

* 4 he does not have to yield to cross traffic." 

Years of Education 



Percent Correct: 



National 
Average 

I 

70 



8 years less than High School 
or less 12 years Graduate 

i 1 

45 63 



i 

72 



Some 
College 

1 

84 



College 
Graduate 



— i 
92 



ITEM 26: Examiner says* as respondent reads along: 

"Shown here are 4 imaginary states. 

Part 1 . Which state has the most representatives in Congress? (Correct response: State B ) 

Part 2. Which state has the most senators in Congress?" (Correct response: "all have same or like amount") 

































c 







Years of Education 



National 
Average 
Percent | 

Correct: Parti. 86 
Part 2. 51 



8 years 
or less 



68 
26 



less than 
12 years 

1 

80 

37 



High School 
Graduate 

1 

90 

49 



Some 
College 
1 

95 

69 



College 
Graduate 



97 
85 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education DiiaeminatkM Review Panel.' 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 27: Examiner says, as respondent reads along: 

"Open shop" is a term which means: 

1 the shop is open 24 hours a day 

2 members of any race can work here * 
* 3 no one has to join a union 

4 customers can shop here without a membership." 



Years of Education 



Percent Correct: 



National 
Average 

I 

67 



8 years 
or less 



less than 
12 years 



High School 
Graduate 



Some 
College 



I 

43 



I 

55 



72 



75 



College 
Graduate 



— i 
90 



ITEM 28: Examiner says, as respondent reads along: 

"Mrs. Olson got the following receipt. How much change would she get back from a twenty dollar bill?" 
(Correct response: $17.64) 



GROVE PHARMACY 
209 East 6th 
Phone - 478-4863 

$ 01.00 drB 
$ 01.25 drB 

$ 02.25 TLB 
$ 00.11 TXB 

$ 02.36 TLB 

Thank You - - Call Again 



Years of Education 

National 8 years less than High School Some College 
Average or less 12 years Graduate College Graduate 

I i 1 1 1 1 

Percent Correct: 72 54 68 77 76 77 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated but labelled in handwriting. "O.K. 3/25/75." 
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APL - Test Items 




ITEM 29: 


Examiner says, as respondent reads along: 

"Isabelle Adams took a vocational interest test. She made high scores in the clerical and 
computation areas. Which job best fits her interests? 








1 stenographer 










* 2 payroll clerk 










3 courtroom clerk 










4 receptionist." 


Years of Education 








National 8 years 
Average or less 


less than High School Some College 
12 years Graduate College Graduate 



Percent Correct: 



I 

62 



I 

37 



I 

53 



i 

61 



i 

79 



— i 
89 



ITEM 30: Examiner says, as respondent reads along: 

"Robert Murphy prefers an inside desk job. He is good in math. He has attended two years of high 
school where he took business courses. Which ad should he answer?" 
(Correct response: #7) 



TRUCK OfttVf* • mitt Htv* CMMM** 
ticwtit. Aril cwnptnr tomtits with •cotli 
tfwrtof. A* IrMH OtMtuAHy Im*«ytf. 
Cwttoct 14 JCiiftflM* C*c«J« Umtor 
C M IRHV * MM3R1. 



NCIOIO BACKHOt *r** « 

Uiiir >»ft t f t» RrtM tftft t tft tor u«ck 
Rrl*. AIM* to**** tor w««r Mwtr 
I Wit c«i»trvc!toA. Ufvi mtttf ti 
25544*4. 



SOCIAL WOAKtR*TtAlN€ff - Ml 

nmmt nm wmn st«M§T AMity 

otfvtmttl ItMfttit CaN r*w 4444711, 
RtfuMk PwmmmI iRnrtct atf I Stvth 1H 

ai 

IMMlOIATt OPINING tor t 
cMtirudtm toR*w with wmt ktw«ltRtt 
•f «M*lrwcttoa» *MJ*; MR ftr 



AW. MANAGING COUPLE 
41 unit complex in University 
area* Furnished apartment 
and salary. Experience t«tr»« 
rial. 4659927, 4*3.4545.! 
452*3314: ^ 



4 
5 
4 



rk«tf «l R x rlwi t«Rfrltnct H t 

7 (INM vRKfc MR t Rtflft tR math wlR Rt 
— - 1 1 ■< i < « — jk 1. til., din — -»» 

Ytkt CRM NRfft Rft IBCtftAf RflR ftWRfRtoR 
CVHf. ORRR RRRTR • Rtolft CRIt 

t 1* it i ain »■ ■-- ^ — T^^,^^ rMiuMMli 



d 



OUTPOST IMIICUI • ft* 
full «fiR R«rt ttfM Mr. Ito ctRtfltACt 
wctttfy. 13R3S RtMKdt 1S2 3Mt, 



LEGAt'AlDE 



IR YOWR R1 m TlRlSTRO in Mrn^R 
SISSR • iwoNl R»t ttfM wHR #b 
to wwRwtR f «t «HR tolly rttWflwRtt. ctll 
Mr. wwiRfM cotLicr. i\$-ninm. 



TRAINEE 



.RftflMlMWl RtfltRRt W Wktlftf 

9. RURttlltoR wlH wto y«vr w«v Wrtt to* 
» i«c* tow RftoR. Stcy«mR? rm. J tm 
•tt* R*RR 444441! SMlltof A SfttUto* 
KwMtywf Sv HI I tow m fc Cfr. 

IQ irmitow>wif» am, 4g4m 



■CONTIOUU • . AOORfSSIVf 
|Acc*«ftf* R»R*«t. iiR«rit»c«R 

Mow potMtoR wNR c sRQffcRWif p^^tontowBl 
itnHct R#Rty toj T'WRt 

U DENTAL ASSISTANT » hRur$ WHRtv -I 
WHI !f«Rl. Wrtto tR« AR MfM R R! 




Years of Education 



National 8 years less'iian High School Some College 

Average or less 12 years Graduate College Graduate 

I i 1 J 1 1 

Percent Correct: 62 33 54 64 77 88 



Source: "The Adult Performance Level Study: A report submitted to (he Office of Education Diuemination Review Panel." 
Undated but labelled in handwriting "O.K. 3/2V75." 



0 09 Adult Performance Level Study • 1975 

IERLC 04 



87 



Figure 58 



APL - Test Items 



ITEM 31 : Examiner says, as respondent reads along: 

"Dandy Employment Agency charges a fee of 4% of one's annual pay. The agency found z 
job for Mr. Jones at $8,000/year. If Mr. Jones wants to make $80 a month payments, how 
many months will it take him to pay the agency's fee?'* 
(Correct response: 4 months) 



Years of Education 

National 8 years less than High School Some College 
Average or less 12 years Graduate College Graduate 

I i 1 1 1 1 

Percent Correct: 61 28 51 64 81 87 



ITEM 32: Examiner says, as respondent reads along: 

"If the government ordered a 15% reduction in home heating fuel, how much oil would a 
family get if they had been burning 200 gallons a month?" 
(Correct response: 170 gallons) 



Years of Education 



National 8 years less than High School Some College 

Average or less 12 years Graduate College Graduate 

I I 1 1 1 : — I 

Percent Correct: 63 42 52 65 74 84 



ITEM 33: Examiner says, as respondent reads along: 

"Here is a sign posted in a restaurant." 




TODAY'S SPECIAL 



Blue Plate Special $1.25 Coffee .25 

Businessman*! Delight $1.00 Tea .20 

Drinks not included on specials Milk .15 



Three men had lunch together. Two of the men had the Blue Plate 
Special and coffee, while the third man only had coffee. Including a 
4% food tax, figure the total cost of the lunch for the three men. 
(Correct response: $3.38) 

Years of Education 

National 8 years less than High School Some College 
Average or less 12 years Graduate College Graduate 

I i 1 1 1 \ 

Percent Correct: 58 40 51 61 65 68 



Source: "The AduW Performance Level Study: A report submitted to the Office of Education Diuemiiutfjon Review Panel.' 
Undated but labelled in handwriting "O.K. 3/25/75 * 
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APL - Test Items 



ITEM 34: Examiner says, as respondent reads along: 

"G. W. Gibbs saw this ad in the paper Monday morning. His wife had been after him to buy an air 
conditioner* so Tuesday afternoon he left work early and went to the appliance store. When Mr. Gibbs 
inquired about the air conditioner, the salesman told him that the last one had been sold "only an hour 
ago," but they had a "much better" model on "special" for $159.59. What Mr. Gibbs should do is: 

1 call a lawyer 

* 2 report the store to the Better Business Bureau 

3 consider the special as it may be better 

4 leave the store because there's nothing he can do anyway." 




THIS WEEK 

ONLY!! 

5,000 B.T.U. 

• THERMOSTAT CONTROL 

• ALL METAL CASt 

• PORTAtLE INSTALLATION 

• SQUIRREL CAGE SLOWER 



114 



69 

5 YEAR GUARANTEE 



Years of Education 



Percent Correct: 



National 
Average 

! 

58 



8 years 
or less 



i — 
46 



less than 
12 years 

1 

54 



High School 
Graduate 



! 

57 



Some 
College 

"7™ 



66 



College 
Graduate 



— i 
74 



Source: The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel/ 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 35: Examiner says, as respondent reads along: 

"The law states that a sentence of life imprisonment is considered the same as a term of 20 years. If a 
person is eligible for parole after serving 1/3 of his term, how many months would a prisoner with life 
imprisonment have to serve before coming up for parole?" 
(Correct response" 80 months; or 6 years and 8 months) 



Years of Education 

National 8 years less than High School Some College 
Average or less 12 years Graduate College Graduate 

I t 1 1 1 1 

Percent Correct: 47 27 43 48 55 68 



ITEM 36: Examiner says, as respondent reads along: 

"The Sooper Suds Soap Company has contacted Benny Hill to become a part owner for only $1,500. 
In turn, Benny is to find people to invest in the company. Benny then receives 50% of the money 
invested by people he has influenced to join the company. This plan is known as: 

* 1 a pyramid scheme 

2 invest-a-firiend 

3 snowball effect 

4 a bait and switch." 

Years of Education 

National 8 years less than High School Some College 
Average or less 12 years Graduate College Graduate 

I i 1 1 1 1 

Percent Correct: 52 36 52 47 64 71 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemin <tion Review Panel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 37: Examiner says, as respondent reads along: 

"One day, Mr. Morgan spent $32.50. Just out of curiosity, he wanted to know how much went for 
taxes. Here is a breakdown of what he spent: 

• 4 gallons of gasoline at 45* a gallon, total cost $ 1 .80, tax 9* a gallon 

• 2 packs of cigarettes at 50* a pack, total cost $1 .00, tax 26* a pack 

• 1 lunch, total cost $2.20. tax 1 U 

• groceries, total cost $25.00, tax 650 

• medicine, total cost $2.50, no tax 

How much did Mr. Morgan spend on taxes?" 
(Correct response: $ 1 .64) 



Respondent 

Reads 

Along 



Item 

4 gallons of gasoline 
at 45* a gallon 

2 packs of cigarettes 
at 50* a pack 

1 lunch 

groceries 

medicine 



Total Cost 

$ 1.80 

$ 1.00 
$ 2.00 
$25.00 
$ 2.50 



9* a gallon 

26* a pack 
11* total 
65* 
.00 



Years of Education 



Percent Correct: 



National 
Average 

I 

51 



8 years 
or less 



less than 
12 years 



High School 
Graduate 



i 

45 



I 

54 



Some 
College 

1 

53 



College 
Graduate 



— i 
64 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Diwemination Review Panel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 38: Examiner says, as respondent reads along: 

"Deborah Newman is going to deposit this money and check in her checking account. 
Fill out the deposit slip for her." 

(Correct response: $7 in cash + $13.49 in checks, sum of $20.49) 




210 



TWttfegiri 'hrift* ^Vioa ~^=— == 



(^t^P^* of Toms Riven. N.J. 



•t:oai2*»o3SJ»: 



DttenkaNmw 



19-7? 



'RINCETON BANK. 



CASH^ 






















































•a mii 


TOTAt 









Years of Education 



Percent Correct: 



National 
Average 

I 

59 



8 years 
or less 



35 



less than 
12 years 
1 

51 



High School 
Gradu ate 



63 



Some 
College 

1 

74 



College 
Graduate 



71 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel.* 
Undated but labelled in handwriting "O.K. 3/25/75," 
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APL • Test Items 



ITEM 39: Examiner says, as respondent reads along: 

"Floyd was picked up by the police on suspicion of robbing the Ace Liquor Mart. They told him that 
if he signed a confession, he would get off with only one year probation. Floyd signed a confession 
and got 5-15 years in jail from the judge. 

Read this part of a pamphlet on your rights when you are arrested. Mark the sentence that tells why 
Floyd should not have followed the advice he was given." 



Percent Correct: 



YOUR RIGHTS AFTER ARREST 

What Happens After You Are Arrested? 

May You Be Forced To Answer Questions? 

After arrest, you have an absolute right to remain silent 
and not to answer any questions. 

No one has a right to force you to answer questions or 
to sign anything. If someone does try to make you talk or 
sign something by threats or promises, tell the police 
official in charge and your lawyer. No promise made in 1 
the police station will be binding in court. 

Mav You Use The Telephone? 

You have a right to use the telephone as soon as you are 
brought to the station to call your family, or a 
friend, or a lawyer, and to arrange bail. 



} [Correct | 
I Response:) 



Years of Education 



National 
Average 

I 

42 



8 years 
or less 



less than 
12 years 



High School 
Graduate 



i 

18 



I 

31 



I 

47 



Some 
College 

1 

52 



College 
Graduate 



- 1 
59 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 40: Examiner says, as respondent reads along: 

"Joe LeBlanc worked for the State Highway Department. On October 13, everything at work 
seemed to go wrong - cables snapped, a crane got stuck, and Joe backed a pick-up into the 
foreman's car. The foreman, Tom Allen, got angry and fired Joe and the guy who got the crane 
stuck. Joe felt that he had been fired without just cause and filed a complaint. 

Fill out the missing parts of the complaint for Joe." 



HJUAL RIGHTS DIVISION 
STATBfXT OF EMPLOYMENT OPLAIHT 



Name 



City 



Conplainant. 



VS 



City 1 

Respondent 



This complaint concerns 


( ) Hire 


( ) Wages 


( ) Discharge 


( ) Condition 
of 

Employment 




( ) Age 


( ) Sex 


( ) Race 


( ) Handicap 


( ) Creed 


( ) National 
Origin or 
Ancestry 



Please state all relevant details, being specific as to nana, dates, etc. 




QjU. 



Signature of Complainant 



( Correct response: Part 1 - Complainant; Part 2 - Respondent; Part 3 - Complaint concerns discharge; Part 4 -Signature ) 

Years of Education 



Percent Comet: 


National 
Average 


8 years 
or less 


less than 
12 years 


High School 
Graduate 


Some 
College 


College 
Graduate 


Parti 


1 

85 


i 

60 


i 

83 


90 


T 

93 


— i 
92 


Part 2 


38 


20 


26 


41 


50 


54 


Part 3 


79 


53 


69 


85 


90 


90 


Part 4 


76 


50 


72 


80 


85 


91 



Source: "The Adult Performance Level Study: A report lubmitted to the Office of Education Diweminatjon Review Pinel." 
Undated but labelled in handwriting "O.K. 3/25/75." 
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APL - Test Items 



ITEM 41: Examiner says, as respondent reads along: 

M You're going to help Robert Dorney fill out his income tax form. Look at the 1040 Income Tax form 
closely. 

Fill in the parts where there is a blank. 

Below is a tax table that you will need for item number 18." 
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Correct responses: 

Part 1 Line 10 3 

Part 2 Line 18 $682.00 

Part 3 Line 20 $682.00 

Part 4 Line 22 $682.00 



Part 5 Line 28 
Part 6 Line 29 
Part 7 Line 30 



$000.00 
$308.00 
$308.00 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel.' 
Undated but labelled in handwriting "O.K. 3/2V75." 
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APL - Test Items 
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Years of Education 



Percent Correct: 


National 
Average 


8 years 
or less 


less than 
12 years 


High School 
Graduate 


Some 
College 


College 
Graduate 


Parti 


1 

30 


8 


i 

25 


i 

33 


T 
37 


1 

45 


Part 2 


39 


7 


30 


44 


47 


65 


Part 3 


27 


4 


18 


30 


36 


46 


Part 4 


31 


5 


23 


35 


41 


54 


Part 5 


45 


17 


30 


50 


61 


67 


Part 6 


28 


6 


21 


31 


35 


48 


Part 7 


30 


8 


21 


33 


38 


52 



Source: "The Adult Performince Level Study: A report lubmitted to the Office of Educabon DiuenuMtion Review Panel.' 
Undated but labelled ia handwriting "O.K. 3/25/73.* 
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APL • Test Items 



ITEM 42: Examiner says, as respondent reads along: 

"Two Ton Tony" stopped in at the Palace Bar and Grill after work. He drank six 8-ounce glasses of 
beer and three 1 1/2 - ounce shots of 100 proof whiskey. He also ate a box of pretzels (50 sticks). 
How many calories did Tony take in at the Palace? 11 

(Correct response: 1,175) 









Number of 








Calorics 


Pancakes (griddle cakes): 








Wheat (home recipe) 


1 


cake, 4 in. in diameter 




Buckwheat (with buckwheat pancake mix) 


• 
I 


cake, 4 in. in diameter 




Pizza (cheese) 


c 

5 


1/2 inch sector, 1/3 or 








a 14 - inch pie 


1 Q< 
iOD 


Pretzels 


c 


small sticks 




Rye wafers 


2 


wafers, 1 7/8 by 3 1/2 


45 


Carbonated beverages: 








Ginger ale 


8 


- ounce glass 


70 


Cola-type 


8 


- ounce glass 


95 


Alcoholic beverages: 








Beer, 3.6 percent alcohol by weight 


8 


- ounce glass 


100 


Whisky, gin, rum: 








100 -proof 


1 


jigger (1 1/2 ounces) 


125 


90 -proof 


1 


jigger (1 1/2 ounces) 


110 


86 - proof 


1 


jigger (1 1/2 ounces) 


105 



Percent Correct: 



National 
Average 

I 

56 



8 years 
or less 



r— 
25 



Years of Education 



less than 
12 years 



High School 
Graduate 



i 

44 



I 

59 



Some 
College 

—i 

72 



College 
Graduate 



— i 
79 



Source: "The Adult Performance Level Study: A report submitted to the Office of Education Dissemination Review Panel." 
Undated hit labelled in handwriting "O.K. 3/25)75." 
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National Assessment of 
Educational Progress 
Literacy: Profiles of 
America's Young AduIts-1986 

In 1985 the National Assessment of Educational 
Progress studied the literacy skills of young adults 
(21-25 years old) living in households in the 48 
contiguous United States. Like all previous surveys 
of adult literacy, the 1985 survey gave data on the 
percent of young adults who performed various 
literacy tasks correctly. However, the report primarily 
reported literacy scores using scale scores for three 
different domains of literacy tasks: prose, document, 
and quantitative literacy tasks. The scale scores for 
each of three different types of literacy task domains 
ranged from 0 to 500, with the majority of tasks 
(items) falling between 200 and 400. Pages 100 



through 112 present samples of items from the 
young adult literacy survey (YALS). More expla- 
nations about the scale scores will be found on those 
pages. 

To show how performance on the YALS compares 
with earlier adult literacy assessments, the figure 
below shows skill levels on the prose, document, 
and quantitative scales in terms of average percent 
correct scores for people at different levels of edu- 
cation. The figure also shows on the right side the 
relationships among education level and the en- 
gagement in various literacy practices (reading books, 
magazines, and newpapers). Both the skill and 
practices data resemble the findings of Buswell in 
1937 (p. 43) and the Adult Functional Reading 
Study of 1973 (p. 63). People with more education 
read more and they have higher reading skills. 



Figure 68 



Young Adults Literacy Study; YALS - 1986 



Literacy Practice 




Education Level 



College 
Degree + 



NAEP Young Adult 
Literacy Scales 



Document 
Prose 

Quantitative 



Source: I. Kinch and A Jungeblut. (1986) Literacy: Profiles of 
America's Young Adults. Princeton, NJ: Educational Testing Service, 
National Assessment of Edocttkmal Progress. (Table 4.1, p. IV* 4) 



Orad College 
HS Degree + 

Education Level 

Read a book in the last 6 months 

Read a newspaper daily 

Read 6 or more mag. on a rag. basis 



Source: I. Kinch and A Jungeblut. (1916) Literacy: Profiles of 
America's Young Adults. Princeton, Ni: Cdscarional Testing 
Service, National Assessment of Educational Progress. (Table 6. 14. 
6.15, 6.16, p. IV- 20 -VI* 22.)) 
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Prose Literacy * 



Locate and underline the statement that indicates what the swimmer ate to keep up her strength during the swim. 



Swimmer completes 
Manhattan marathon 



NEW YORK-Unive.rW of 
Maryland senior Stacy Chanin 
on Wednesday btcama the first 
person to swim three 28*mile 
laps around Manhattan. 

Chanin, 23, of Virginia, 
climbed out of the East River 
at 96th Street at 9:30 p.m. She 
began the swim at noon on 
Tuesday. 

A spokesman for the swim* 
mer, Roy Brunttt, said Chanin 
had kept up her strength with 
"banana and honey sand* 
wiches, hot chocolate, lots of 
water and granola bars." 

Chanin has twice circled 



Manhattan before and trained 
for the new feat by swimming 
about 28.4 miles a week. The 
Yonkers native has competed 
as a swimmer since she was 15 
and hoped to persuade Olym- 
pic authorities to add a long- 
distance swimming event. 

The Leukemia Society of 
America solicited pledges for 
each mile she swam. 

In July 1963, Julie Ridge be* 
came the first person to swim 
around Manhattan twice. With 
her three laps, Chanin came up 
just short of Diana Nyad's dis- 
tance record, set on a Florida* 
to-Cuba swim. 
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Task Difficulty: 210 

Skill Level of Respondents 

1 2> 210 150 

I 1 



200 



250 
— I — 



300 
— I — 



350 
— I — 



80 



32 



74 



94 



99 



100 



Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



400 



450 



100 



100 



Source: I. Kirsch and A. Jungeblut. (1986a). Literacy: Profiles of America's Young Adults. Princeton, NJ: Educational Testing Service, 
National Assessment of Educational Progress, (p. 1 1) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 



In the young adult literacy survey (YALS), both 
people and tasks (items) were given scale scores. For 
instance, a person with a skill level of 210 would 
haveaprobabilityof.80ofperformingataskthathas 
a difficulty level of 210 (see item above). All of the 
sample tasks presented on pages 100 through 1 12 
show the task difficulty of the item and the probabil- 
ity that people with different skill levels could per- 
form the item. In the item above, the task difficulty 
is 2 10, and people with a 2 10 skill level have an 80% 



probability of being able to perform the task. How- 
ever, other people with lower skill levels may also be 
able to perform the task, though with lower prob- 
abilities. In the item above, people with skill levels 
of ISO have a 32% probability of being able to 
perform the task that is at the 210 difficulty level. 
People at the 200 level have a 74% probability of 
performing the task. People at the 300 skill level 
have a 99% probability of performing the 210 
difficulty level task. 
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Prose Literacy * 



A manufacturing company provides its customers with the fol- 
lowing instructions for returning appliances for service: 



When returning appliance for servicing, include a note telling as clearly and 
as specifically as possible what is wrong with the appliance. 



A repair person for the company receives four appliances with the 
following notes attached. Circle the letter next to the note which 
best follows the instructions supplied by the company. 



The clock does not run 
correctly on this clock 
radio. I tried fixing it, but 
I couldn't. 



The alarm on my clock 
radio doesn't go off at the 
time I set. It rings 15-30 
minutes later. 



B 



My clock radio is not working. It 
stopped working right after I 
used it for five days. 



D 



This radio is broken. Please 
repair and return by United 
Parcel Service to the address on 
my slip. 



Task Difficulty: 279 

Skill Level of Respondents 
— > 279 150 



(Reduced from original copy) 



L 



200 



250 



r 



80 



27 



35 



62 



300 
— r— 
89 



350 
— I— 



400 



450 



98 



100 



100 



Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: I. Kirsch and A. Jungeblut. ( 1986a). Literacy: Profiles of America s Young Adults. Princeton. NJ: Educational Testing Service, 
National Assessment of Educational Progress, (p. 12) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 



This test item has a task difficulty of 279, meaning 
that people with a skill level of 279 have an 80% 
probability of being able to perform the task. People 
at a skill level of 1 SO have only a 27% probability of 
being able to perform this task, while people at a skill 
level of 300 have an 89% probability of performing 
the item and those at a skill level of 3S0 have a 98% 
probability of performing the task. 



On the Prose scale, the YALS report states that, over 
all items, 

99.7 percent perform at the ISO level or above, 
96. 1 percent perform at the 200 level or above, 
82.7 percent perform at the 250 level or above, 
56.4 percent perform at the 300 level or above, 
21.1 percent perform at the 350 level or above, 
8.8 percent perform at the 375 level or above. 
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Figure 71 



Prose Literacy * 



Synthesize the main argument from the following newspaper column. 

Did U.S. know Korean jet was astray? 



THE COMPLICITY with 
government into which tht 
prttt hM Mink since Vietnam 
and Watergate he* seldom 
been more visible than on the 
fim anniveraaiy of Soviet de- 
struction of Korean Air lines 
Flight 007. 

On Sept. 1. headlines, of 
course, reported the Reagan 
administration's statements 
that the event had honsted. 
during tha year. U.S. standing 
in the world relative to that U 
the U.S.S.& 

Rut the press effectively ig- 
nored an authoritative article 
in The Nation (for Aug. 18-25) 
establishing to a r eas on able 
certainty that numerous U.S. 
government agencies knew or 
should have known, almost 
from the moment Flight 007 
left Anchorage. Alaska, that it 
was off course and headed for 
intrusion into Soviet air space, 
above some of the most 
sensitive Soviet military in- 
stallations. 

Yet no agency, military or 
civilian, warned Flight 007 or 
tried to guide it out of danger: 
neither did the •Japanese. As 



late as Aug. 28. in a briefing, 
a State Department spokes- 
man claimed "no agency of the 
U.S. government even knew 
the plane waa off course and 
was in difficulty until after it 
was shot down. 

If that's true, the author of 
The Nation's article* David 
Pearson, an authority on the 
Defense Department's World 
Wide Military Command and 
Control System, who spent a 
year researching his lengthy 
article- concludes, "the 
elaborate and com pies system 
of intelligence, warnings and 
security that tha U.S. has built 
up over decades suffered an 
unprecedented and mind-bog- 
gling breakdown." 

But Pearson shows in ei« 
cruciating detail why it's moat 
unlikely there was any such 
"simultaneous failure of inde- 
pendent intelligence systems" 
of the Navy. Army. Air Force. 
National Security Agency. 
Central Intelligence Agency 
"or the Japanese self-defense 
agency"— si! of which, he 
shows, had ability to track 
Flight 007 at various stages 



Tom 
Wicker 



acmes the Pacific. 

What's the alternative to the 
staggering idea of such a break • 
down? That all these agencies 
deliberately chose not to guide 
the airliner back on a safe 
course, because its projected 
overflight of the Kamchatka 
Peninsula and Sakhalin Island 
would activate Soviet radar 
and air defenses and thus yield 
a "bonania" of intelligence in- 
formation to watching and 
listening U.S. electronic de- 
vices. Despite all adminis- 
tration protests to the con- 
trary, the evidence Pearson 
presents raises this alternative 
at least to the I jgh probability 
level. 

But Pearson does not assert 
as a fact that the United 
States. South Korea or both 
deliberately planned an in- 
telligence mission for Flight 



007; he concedes the possibility 
that it simply "blundered" 
into sensitive Soviet air space, 
and that electronic onlookers 
for the United States decided 
on the spot to take intelligence 
advantage of the error— never 
dreaming the Russians would 
shoot down an unarmad air- 
liner. 

But if the disaster happened 
that way. Pearson notes, two 
experienced pilots < nearly 
20.000 flying hours between 
them) not only made an emir 
in setting the automatic pilot 
hut "sat in their cockpit ft* 
five hours, facing the autopilot 
selector switch directly in front 
of them at eye level, yet failed 
to see that it was set improper- 
ly." Nor in all that time could 
they have used the available 
radar and other systems to 
check course and position. 

Pearson also presents 
substantial evidence that Sov* 
iet radar detection and com- 
munications aystems over 
Kamchatka and Sakhalin were 
being jammed that night, 
which would help account for 
their documented difficulty in 



catching up to Plight 007. He 
reconstructs electronic evi- 
dence ton. to show that the air- 
liner changed course slightly 
after passing near a U.S. 
RC-135 reconnaissance plane; 
otherwise it would have cr o s sed 
Sakhalin far north of the point 
where a Soviet fighter finally 
shot it down. 

The jamming and course 
change, an detailed by Pearson, 
strongly suggest what he ob- 
viously fears: "that K.A.L. 
007 s intrusion into Soviet air* 
space, far from being acciden- 
tal, waa well on hast rated." 
with tht Reagan adminis- 
tration, at some level, doing 
the orchestrating. Even if not. 
the deliberate silence— or 
shocking failure -of an many 
U.S. detection systems argue 
that President Reagan and the 
security estsblsthment have 
greater responsibility tor Flight 
OOTs fate than they admit— or 
that a complaisant press has 
been willing to seek. 
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Task Difficulty: 340 

Skill Level of Respondents 
1 > 340 150 
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— I— 



350 



400 



07 



24 



56 



84 
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450 
—I 
98 



Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: 



I. Kirsch and A. Jungebtut. (1986a). Literacy: Profile* of America's Young Adults. 
National Assessment of Educational Progress, (p. 13) 



Princeton. NJ: Educational Testing Service, 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 



This item has a difficulty level of 340, meaning that 
people must possess a skill level of 340 to have an 
80% probability of performing this task. Note, though, 
that people with a skill level of 300 have a 56% 
probability of performing the task, and those with a 
skill level of 2S0 have a 24% probability of being 
able to perform the task. This illustrates that even 
though people may not be at the level of skill 
demanded for having an 80% probability of per* 
forming the task, they may nonetheless be able to 
perform it, albeit with a lower probability of success. 



The YALS technical report states that, "Successful 
performance was determined to be that point on the 
item characteristic curve (ICC) at which an individual 
has an 80% probability of correct response to a given 
task or 80% of the people respond to the task cor- 
rectly. Therefore, population estimates at specified 
points along each scale represent an 80% probability 
criterion. Use of this criterion does not imply that 
individuals scoring below a given level will be 
unable to respond correctly to any task above his/her 
estimated level of proficiency" (see Figure 68, p. 99 
for sources of this quote: Kirsch AJungeblut, 1986, 
p. IV-12). 
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Prose Literacy * 



12. What is the poet trying to express in this poem? 



The pedigree of honey 
Does not concern the Bee — 
A clover, any time, to him 
Is Aristocracy — 



(Emily Dickinson) 



Rcprii**! by penwiuKm of Um pufeluhm and U* Tn**ot« of Amhent CoJlefe fnm TV Potim ofEmty Dkbiwm. «fc»d by Thcmm 
H. John**. Cambridge. Mm.: The Belknap Pre* of Huvani University ftm. Cofyn|ht 193 1. © 1935. 1979. 19S3 by the Prcstdeat 
md fellows of Harvard CoUefe. 



Task Difficulty: 387 

Skill Level of Respondents 
1 > 387 150 
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61 



85 



95 



Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: I. Kirsch and A. Jungeblut. (1986a). Literacy: Profiles of America's Young Adults. Princeton. NJ: Educational Testing Service, 
National Assessment of Educational Progress, (p. 14) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 



This item has a difficulty level of 387, meaning that 
people must possess a skill level of 387 to have an 
80% probability of performing this task correctly. It 
is interesting to speculate about why interpreting this 
poem, with only seventeen words, is more difficult 
than the proceeding task about Tom Wicker's New 
York Times article. The latter has several hundred 
words and numerous sentences. Yet it was easier for 
more people to synthesize the main argument from 
Wicker' s article than to say what the poet was trying 
to express in the brief poem above. According to the 
YALS, only 8.8 percent of the young adult popula- 
tion possessed Prose skill levels of 375 or above. So 
fewerthanoneinten young adults would be expected 
to perform the poetry interpretation task correctly. 
However, note that people with a skill level of 350 
have a 61% probability of performing the task, and 
those at a skill level of 300 have a probabilty of 31% 
of being able to perform the task correctly. Thus, 



even though only fewer than ten percent of the young 
adults are at the 375 level or above, more than that 
could be expected to perform the task if the standard 
for performing correctly was set lower than an 80% 
probability. For instance, if the standard for being 
defined as possessing skills at a given level were set 
at 60%, then the poetry item would be said to have a 
difficulty level of 350, and all those presently scoring 
at the 350 level or above (21 percent of the young 
adults) would be designated as possessing the skills 
for performing this task. This illustrates that in the 
YALS study, whether one is below, at, or above a 
given skill level depends upon the standard for 
performance that is establishedby the test developers. 
In the absence of any compelling basis for establishing 
a standard, any standard that is set is arbitrary. It 
represents a judgment about how good is good 
enough to be called proficient at a given skill level. 



10 National Auenment ofEducatiyi^Progr*** and ProfiU* - 1986 



103 



Figure 73 



Document Literacy * 



Using the meeting room form below, enter the "time" of the meeting in a space provided. 



N0SMTJO. KtOJCftl CtKTtr 

mrr cducfcrtot; ocfartmck? 





t*ef<M» 




tit fl*, T»k(«> 
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Task Difficulty: 169 

Skill Level of Respondents 
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Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: 1. Kinch and A. JuageMtK. (1986e). Literacy: Profile* of America'* Young Adult*. Princeton. NJ: Educational Testing Service. 
National A**e**atM of Educational Prograt. (p. 30) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 



This Document literacy task is at the easy end of the 
scale, with a difficulty level of 169, meanir? that 
people must possess a skill level of 169 to have an 
80% probability of being able to perform the task 
correctly. 



On the Document scale, the YALS report states that, 
over all items, 

99.7 percent perform at the ISO level or above, 
95.5 percent perform at the 200 level or above, 

83.8 percent perform at the 250 level or above, 
57.2 percent perform at the 300 level or above, 
20.2 percent perform at the 350 level or above, 

8.8 percent perform at the 375 level or above. 



ERIC 



Adult Literacy in the United State* 

110 



Figure 74 



Document Literacy * 



SHOPPING LIST 
milk 

instant coffee 

bread 

cake mix 

margarine 

hamburger 

eggs 

potato chips 



Match items in the shopping list to the money-saving coupons. 

11111^ SS&ttSotf ***** •*•*** 

If* 





2j= ■ — , 




¥ j*t^PWW> _ v \ / y 5 " 7Ti 

1% 



.«; 



fir* I -s t «: 



L^a-^rgS E *2Jt WITH I0NUS KNIS 




Task Difficulty: 211 

Skill Level of Respondents 
1 > 211 150 



(Layout ws* reviled slightly 
from the assessment to accommodate this report) 
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Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: I. Kitsch and A. JungeMut. (1916a). Literacy: Profiles of America's Young Adults. Princeton, NJ: Educational Testing Service, 
National Assessment of Educational Progress, (pp. 21-22) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 



This Document literacy item has a task difficulty of 
211. Therefore, people must possess a skill level of 
21 1 to have an 80% probability of being able to 
perform this task. The data for this task indicates 
that people with a skill level of ISO have a 60% 
probability of being able to perform the task, while 
those with a skill level of 300 have a 94% probability 
of being able to perform the task. It is instructive to 
compare this task to Guy Buswell's Price List test 
(page44)of 1937. 



This comparison shows that the concept of 
the types of literacy tasks that adults are 
expected to perform has not changed com- 
pletely in the last half century. 
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Document Literacy * 



Write the "gross" pay for this year-to-date:. 
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Task Difficulty: 257 

Skill Level of Respondents 
> 257 150 
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Source: 



I. Kirsch and A. Jungeblut. (1986a). Literacy: Profiles of America's Young Adults. Princeton. NJ: Educational Testing Service, 
National Assessment of Educational Progress, (p. 23) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 



In the Document literacy assessment, 73 percent of 
the tasks demanded 300 level skills or lower , while 
57.2 percent of young adults possessed 300 level 
skills or higher , thus, the Document tasks tended to 
be skewed toward the easy end of literacy task 
difficulties. Overall, the average percent correct for 
Document literacy tasks was 83.3 (Table 4.1, page 
IV-4 of the source cited on page 99). Whites scored 
8S.9, Hispanics 77.6, and Blacks 71.8 percent cor- 
rect on the average for Document tasks. While 65.4 
percent of Whites scored at the 300 skill level or 
higher, only 37.0 percent of Hispanics and 19.8 
percent of Blacks scored at the 300 skill level or 
higher (see Figure 4.2, page IV- 18 of the source 
document cited on page 99). Note that, if one focusses 
on the fact that only one in five Blacks were at the 
300 skill level or above on the Document scale, one 



might infer a very low performance level for Blacks 
on Document tasks. Yet, overall, Blacks performed 
over 70 percent of the Document tasks correctly. 
This apparent contradiction results from the fact that 
to be at the 300 level of skill requires that people 
possess an 80% probability of being able to perform 
tasks that are at that level of difficulty. But people 
with lower levels of skill have a greater than zero 
probability of being able to correctly perform 300 
level tasks. When the latter are taken into consider- 
ation, as in calculating the overall average percent 
correct, then a much greater percentage of the 
population may be seen to be able to perform 
Document tasks across the full range of difficulty 
levels, from easy to hard, than are able to perform 
tasks at the 300 level of difficulty or above. 
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Document Literacy * 



The graph below shows predictions of United States 

energy consumption through the year 2000. Use the graph to answer 

the questions that follow. 



Estimated U.S. Power Consumption by Source 



| COAL 
[ 2 1 PETROLEUM 
[ j NATURAL GAS 
| j NUCLEAR ROWER 

| HYOROROWER 



111S 



NO 



ft.O 





16 <' 



43 V. 




24 



1t71 



19t0 



1MS 



2000 



Source: U.S. Oeptranem of Interior United Sues Energy Through the Year 2000. 

BTU: Quantity of heat required to ruse temperature of one pouad of waicr one degne ftheeahen. 

COPYRIGHT 1973 CONGRESSIONAL QUARTERLY INC. 



In the year 2000, which energy source is predicted to supply less 
power than coal? 
A Petroleum 
B Natural gas 
C Nuclear power 
D Hydropower 
E I don't know. 



(Reduced from original copy) 



Task Difficulty: 294 

Skill Level of Respondents 
1 > 294 150 
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Source: I. Kinch and A. Jungtblut. (1986a). literacy: Profiles of America'* Young Adults. Princeton, NJ: Educational Testing Service, 
National Assessment of Educational Progress, (p. 25) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 
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Document Literacy * 



Refer to the following bus schedule for the Vista Grande route. 
Use the bus schedule to answer the questions. 



5 



VISTA GRANDE 



Wmwf wwm mow* m^w+n Swdh mnm«t wi' 
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10 IS 




Mi 


9:18 


9*9 


933 


iS^ 


9:49 


9*7 


10:18 


10:17 


10*7 


19:48 mmi^i ■ iiw niii im 


920 


935 


945 


950 


1003 




10.15 


10 27 


t0 42 


tC47 


10 57 


11 15 


1020 


10 35 


10 45 


1050 


11 03 


11 15 


11 IS 


11 27 


1142 


11 47 


11 57 


12 IS 


11 20 


11 35 


11 45 


11 50 


1203 


1215 


12 15 


1227 


1242om 


1247 om 


1 2 57 o «» 


1 15 om 


12-20 


12 35 


1245 


1250 


1 03 


1 15 


1 15 


127 


1 42 


1 47 


1 57 


2 15 


1 20 


I 35 


1 45 


1 50 


203 


215 


215 


2 27 


2 42 


2 47 


2 57 


315 


220 


2 35 


2 45 


250 


303 


3 15 


315 


327 


342 


3 47 


3 57 


4 15 




vm 


3:19 


3*0 


3*3 


3:48 


3:4$ 


3*7 


4:18 


4:17 


4*7 


448 Ml <ll» H|M 


PMfS 


3.35 


345 


350 


403 


4 15 


4 15 


4 27 


4 42 


4 47 


4 57 


5 15 




406 


4:18 


4J9 


4*8 


4:48 


4:48 


4*7 


9:12 


9:17 


9:17 


5:48 mmm**—*** mm* 


420 


435 


4 45 


450 


503 


5 15 


SIS 


5 27 


5 42 


5 47 


5 57 


615 


4 JO 


8*6 


8:18 


9:99 


9*3 


8:48 


8:48 


9*7 


9:12 


917 


9*7 


6:48 Hi m >^Mtfi Mw«» 


520 


5 35 


5 45 


550 


603 


615 














8*6 


606 


9:18 


9*0 


9:38 


6:48 














620 


6 35 


645 


650 


703 


7 15 































































On Saturday afternoon, if you miss the 2:35 bus leaving 

Hancock and Buena Ventura going to Flintridgc and Academy, 

how long will you have to wait for the next bus? 

A Until 2:57 p.m. 

B Until 3:05 p.m. 

C Until 3:35 p.m. 

D Until 3:57 p.m. 

E I don't know. (Reduced ^ 0fi « iMl 



Task Difficulty: 36S 

Skill Level of Respondents 



365 



150 



200 



250 
— I — 



300 



350 
— I — 



400 
— I — 



450 

— 1 



-> 80 



18 



19 



21 



35 



70 



93 



99 



Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: 



I. Kitten and A. JungeWut. (1986a). Literacy: Profiler of America's Young Adults. Princeton. NJ: Educational Testing Service. 
National Assessment of Educational Progress, (p. 26) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 
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Figure 78 



Quantitative Literacy * 



Total the two entries and write the answer in the "total" space. * 



NATIONAL BANK 



CASH 



(Phue Print} 
Name 



Pieaw ust vour ptrsontlutd dtootit ttcktts. 
If you need mort. stt your otrtontl banlctr. 



ac suae 

EACH ITEM 1$ 

PROPERLY 

ENDORSED 



iSit^nJiy 



Dollsrt 

57 



300 



.19. 



Total Ittrm 



TOTAL 



Ctnt* 

23 



oo 



CHECKS AND OTHER ITEMS ARE RECEIVED FOR DEPOSIT SUBJECT TO THE PROVISIONS OF THE 
UNIFORM COMMERCIAL CODE OR ANY APPLICABLE COLLECTION AGREEMENT. 



* Note: In the administration of this task, respondents first had to write the numbers in the spaces provided and then total them. 
Task Difficulty: 233 (Reduced from original copy) 



Skill Level of Respondents 
> 233 150 



I— 
80 



200 
— I— 



250 



300 



350 
— I— 



400 
— r— 



450 



32 



63 



86 



96 



99 



100 



100 



Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: I. Kirsch and A. Jungebtut. (1986a). Literacy: Profiles of America's Young Adult*. Princeton. NJ: Educational Testing Service, 
National Assessment of Educational Progress, (p. 31) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 



This Quantitative literacy task has a difficulty level 
of 233, meaning that people must possess a skill 
level of 233 to have an 80% probability of being able 
to perform the task correctly. 

On the Quantitative scale, the YALS report states 
that, over all items, 

99.6 percent perform at the 150 level or above, 

96.4 percent perform at the 200 level or above, 

84.7 percent perform at the 250 level or above, 
56.0 percent perform at the 300 level or above, 

22.5 percent perform at the 350 level or above, 
9.5 percent perform at the 375 level or above. 

On the Quantitative literacy scale, the overall per- 
cent correct was 65. Whites scored an average of 
68.9%, Hispanics 57.8% and Blacks 45.8% correct. 
Only 47% of the Quantitative literacy tasks were at 
or below a difficulty level of 300. This contrasts with 
the Document literacy scale where 73% of the tasks 
were at or below the 300 level of difficulty. On the 



Quantitative scale, there were no tasks below a 
difficulty level of 250. Despite this, the theoretical 
curves relating ability to the 80% probability of 
being able to perform tasks at different difficulty 
levels leads to the reported (hypothetical) finding 
that 96.4%, and not 100%, of young adults would 
perform at the 200 level or above. This occurs even 
when there are, in fact, no items at the 150 or 200 
levels. 

Note: In the assessment of Job Training Partnership 
Act (JTPA) opportunities and job seekers using the 
Unemployment Insurance (UI) systems, this item 
required "the reader to enter and total two numbers 
"on the bank deposit slip." It is cited as having a 
difficulty level of 226 (I.Kirsch, A. Jungeblut, and 
A. Campbell, (1992, September). Beyond the School 
Doors: The Literacy Needs of Job Seekers Survival 
by the U.S. Department of Labor. Washington, DC: 
U.S. Dept. of Labor, Employment Training Admin- 
istration, (p. 51) 
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Figure 79 



Quantitative Literacy * 



Complete the check ledger for the month of September. Keep a 
running total of the balance and include the following: 

$50 deposit on 9/27 

check 108 payable to Mr. Davis for $18.49 on 9/27 
check 109 payable to Electric Co. for $53 on 9/28 
the $5 monthly service fee for your checking account 

RECORO AU. CHARGES OH CREWS THAT AFFECT YOUR ACCOUNT 







one— i Pip m-wicrpM 


: wwwwr«mt v 
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mtm nwinwifli' 




ir 


107 


% 
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$ 




for 


3? 
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Paycheck 










37f 

































































































Task Difficulty: 293 

Skill Level of Respondents 



(Reduced from original copy) 



293 



150 



200 



250 



300 



350 
— f— 



400 
— r— 



80 



00 



04 



33 



85 



99 



100 



450 
— I 
100 



Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: 



I. Kirsch and A. Jungeblut. (1986a). Literacy: Profiles of America's Young Adults. Princeton. NJ: Educational Testing Service, 
National Assessment of Educational Progress, (p. 32) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 
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Quantitative Literacy * 



Suppose you had $3.00 to spend for lunch. 

If you order a Lancaster Special sandwich and onion soup, how 
much change should you get back? 



Soups — Made by our Chef Daily 




Onion soup 


60 


Soup of the day 


.60 


Vichyssoise in Summer 




Beef 'burgers, broiled to order. 


t.85 


V* h. of the finest Beef available, seasoned to perfection 




and served on a buttered bun 




Wine Cheddar-cheese burger 


w 1.95 


Blue-cheese burger 


1.95 


Pineapple burger 


1.95 


Bacon burger 


2.10 


Wine Cheddar-cheese & Bacon burger 


2.25 


Sandwiches 




Sliced Turkey — Garnished 


1.30 


Turkey Salad — Garnished 


.95 


Chicken Salad — Garnished 


.95 


Tuna Fish Salad — Garnished 


.95 


Sliced Beef Tongue — Garnished 


1.50 


Grilled Wine Cheddar- Cheese 


75 


The Lancaster Special 


1.95 


Comcd Beef. Melted Swiss Cheese. Sauerkraut 




on Seeded Rye . . . Need we say more? 




Minimum Check at Lunch LOO 





Task Difficulty: 337 

Skill Level of Respondents 
> 337 150 



L 



200 



250 



r 



i— 

-> 80 



300 



350 



(Reduced from original copy) 



400 



450 



01 



06 



23 



57 



86 



99 



Probability That Respondents at Each Skill Level Can Perform the Task Correctly 



Source: I. Kinch and A. JungeMut. ( 1986a). Literacy: Profiles of America's Young Adults. Princeton. NJ: Educational Testing Service. 
National Assessment of Educational Progress, (p. 33) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 
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Figure 81 



Quantitative Literacy * 



You need to buy peanut butter and are deciding between two brands. 

Estimate the cost per ounce of the creamy peanut butter. Write 
your estimate on the line provided 

Circle the letter next to the more economical brand. 



B. 



Unit prica 
11.8C peroz. 



You pay 

1 89 



rich chnky pnt bt 



10693 



16 02. 



Unrtprica 

1.59 per 



You pay 

1.99 



creamy pnt butter 



10732 



I 



20 oz. 



(Reduced from original copy) 



Task Difficulty: 376 

Skill Level of Respondents 



376 



150 
— h- 



200 



250 



300 
— I— 



350 
— I— 



80 



02 



06 



18 



41 



400 
— (— 



450 
—I 



69 88 

Probability That Respondents at Each Skill Level Can Perform the Task Correctly 

Source: I. Kitsch and A. JungeWut. ( 1986a). Literacy: Profiles of America's Young Adults. Princeton. NJ: Educational Testing Service. 
National Assessment of Educational Progress, (p. 34) 



* This item was also used in the 1992 National Adult Literacy Survey (NALS). 
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National Adult Literacy Survey * 1993 

In 1993 the National Center for Education Statistics 
of the U.S. Department of Education reported the 
results of a survey of the literacy skills of adults aged 
16 to over 65 living in households in the United 
States. Additionally, the survey studied the literacy 
skills of incarcerated adults. The National Adult 
Literacy Survey (NALS) used the same prose, 
document, and quantitative scales as used in the 
Young Adult Literacy Survey (YALS). Many of the 
same test items as were used in the YALS were also 
used in the NALS. Pages 100 through 1 12 present 
samples of items from the YALS that were also used 



in the NALS. Additional items were also developed 
for the NALS. Literacy scores were reported using 
the scale scores for the three different domains of 
literacy tasks: prose, document, and quantitative. 
Just as with the YALS, the scale scores used in the 
NALS for each of the three different types of literacy 
task domains ranged fromO to 500, with the majority 
c f tasks (items) falling between 200 and 400. 

The 1993 report of the NALS available at the time 
this report was prepared did not give data on the 
percent of young adults who performed various 
literacy tasks correctly. Nor did the report indicate 
how literacy practices varied as a function of years 



Figure 82 



National Adult Literacy Survey 



Literac y Ski]] 



Literacy Practice 




380 



9-12 HS 



2yr 4yr Grad 
Col Col Studies 




Never Reads Newspaper 
Less Than Once A Week 
Once A Week 
A Few Times A Week 
Every Day 

I I 



Education Level 



2 3 4 
Newspaper Reading 



Source: Irwin Kinch, A. Jungeblut, L. Jenkins, A A. Koltfad (I W?, September). Adult Literacy in America: A First Look at the Results of the National 
Adult Literacy Survey. WMhinftOfl, DC: U. S. Government PrtAtini Office. 
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of education. Therefore, to show how performance 
on the NALS compares with earlier adult literacy 
assessments, the left side of figure 82 shows skill 
levels on the prose, document, and quantitative tasks 
in terms of scale scores for people at different levels 
of education. The figure also shows on the right how 
scalescores varied forpeople whoengaged in various 
amounts of one literacy practice: newspaperreading. 
Both the skill and practices data resemble the find- 
ings of Buswell in 1937 (page 43), the Adult Func- 



tional Reading Study of 1973 (page 63) and the 
Young Adult Literacy Survey (page 99) in showing 
that people with more education have higher reading 
skills, and that people who read the newspaper more 
also have higher reading skills. This confirms the 
earlier findings that skill, practice and education are 
interrelated. Future reports from the NALS are 
planned that will discuss additional relationships 
among education, literacy skills, and literacy 
practices. 
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The NALS Literacy Levels 

The NALS was the first national survey of adult 
literacy skills to report data in terms of five levels of 
skill. These literacy categories are much like the 
categories used by the military since World War I to 
categorize a range of scores obtained by young 
adults into categories of "intelligence" (Army Alpha 
and Beta tests, see page 19 of this report), "general 
learning ability" (Army General Classification Test 
(AGCT), see page 25), and "trainability" (Armed 
Forces Qualification Test ( AFQT), (see page 27). 

The NALS literacy levels are important because 
they are to be used by the National Governor's 
Association and the federal government to track the 
nation's progress on Education Goal Number 5: 
making all adults literate by the year 2000 (National 
Education Goals Panel, 1992, pp. 40-43). 

In the NALS, the five levels used to describe catego- 
ries of proficiency include Level 1 (scale scores from 
0 to 225), Level 2 (scale scores from 226 to 275), 
Level 3 (scale scores from 276 to 325), Level 4 (scale 
scores from 326 to 375), and Level 5 (scale scores 
from 376 to 500). For each of the prose, document, 
and quantitative scales, all those adults with scores 
from 0 to 225 were assigned to Level 1, those with 
scores from 226 to 275 were assigned to Level 2 and 
so forth. Table 4 shows the percentage of adults 
assigned to each of the five literacy levels for each of 
the three literacy scales. 



Altogether, the adult population sampled represented 
approximately 191,O0O,O0Oadults.Thedatain Table 
4 suggest that some 40 to 44 million adults are in the 
lowest level of skill, Level 1 . Some 50 million are in 
Level 2, 61 million in Level 3, 28 to 32 million in 
Level 4 and 6-8 or so million adults are in Level 5. 

Being assigned to one of the five levels means that 
people at the average skill for a given level have an 
80 percent probability of being able to perform the 
average tasks at the given level. For instance, the 
NALS report indicates that a person with a skill level 
of 200 would be assigned to Level 1, for which the 
average task difficulty is about 200 (averaged across 
the three literacy domains). This means that the 
person would be expected to be able to respond 
correctly to 80 percent of the average tasks in Level 
1 . However, this same person would be expected to 
be able to correctly respond to over 30 percent of the 
tasks at Level 2, about 1 5 percent of the tasks at level 
3, 8 percent of the tasks at Level 4 and about 5 
percent of the tasks at Level 5 (Kirsch, Jungeblut, 
Jenkins, & Kolstad, 1993, p. 102). This results from 
the fact that , as indicated in the discussion of items 
for the YALS survey earlier, persons with skill 
levels below the difficulty level of an item may be 
able to perform the item correctly, though with a less 
than 80 percent probability of a correct response. 

The Prose Literacy task item illustrated on page 101 
shows that a person needs a skill level of 279 to have 
an 80 percent probability of being able to perform 
the item that is of 279 difficulty. 



Table 4 


NALS Survey Percentage Levels 


Percentage of adults in each of the five NALS skill levels for each literacy scale. 




Level 1 


Level 2 


Level 3 


Level 4 Level 5 


Prose 


21 


27 


32 


17 3 


Document 23 


28 


31 


15 3 


Quantitative 22 


25 


31 


17 4 
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However, the person with a skill level of 250 has a 
probability of .62 of being able to perform the item. 
Because the person has a skill level of 250, on the 
NALS this would result in the person being assigned 
to Level 2. This would mean that the person has a .80 
probability of being able to perform average Level 2 
tasks. But note that the person would also be able to 
perform Level 3 tasks (which is where a task of 279 
difficulty would fall), but not with as high a prob- 
ability of success. In the NALS report, it is indicated 
that on either the prose, document or quantitative 
tasks, a person with a skill level of 250 can be 
expected to perform 50 out of 100 tasks that are at the 
average Level 2 task, 25 to 30 percent of the tasks at 
Level 4 and 10 to 20 percent of the tasks at Level 5, 
depending on the type of literacy scale under discus- 
sion (Kirsch, et. al. 1993, p. 102). 

By assigning people to a given skill level, the im- 
pression may be formed that the person has no ability 
to perform higher level tasks. But this is wrong. Even 
though people may be assigned to a lower skill level, 
this does not mean that they are totally incapable of 
performing tasks at higher skill levels. In the NALS 
survey, respondents were asked to rate themselves 
as to how well they thought they could read and write 
English. Of those categorized as Level 1 literates, 
some 66 to 75 percent said they could read and write 
"well" or "very well." The NALS authors refered to 
this as the "gap between performance and percep- 
tion," meaning that the literacy skills of those in 
Level 1 are low by NALS methods of setting stan- 
dards for inclusion at one or another level of skill. So 
the self-perceived skills of the vast majority of those 
categorized as Level 1 literates, who rated them- 
selves as "well" or "very well" as literates, must be 
incorrect. They go on to say that "Such a mismatch 
may well have a significant impact on efforts to 
provide education and training to adults: Those who 
do not believe they have a problem will be less likely 
to seek out such services or less willing to take 
advantage of services that might be available to 
them." (Kirsch, et. al. 1993, p. 20). 

But it is possible that many adults labled as Level 1 
literates perceive themselves as quite literate be- 
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cause, as indicated above, they are able to perform 
quite a few tasks at higher levels, even a few at Level 
5. It must be kept in mind that simply because people 
are assigned to a lower level category of literacy 
skill, this does not mean that they are entirely inca- 
pable of performing tasks at higher skill levels. They 
simply do not have a .80 probability of performing 
higher level tasks. That is, they cannot perform them 
with the same high level of probability that is required 
to be categorized at a higher level. This is important 
to keep in mind when one discusses the numbers of 
adults in the different skill levels. The numbers can 
be changed dramatically simply by changing the 
criterion for being categorized into the different 
levels. For instance, if instead of requiring that 
people be able to do 80 percent of the average tasks 
in a given level, the criterion were changed to being 
able to do 70 percent of the tasks, then the numbers 
of people assigned to the lower levels would de- 
crease dramatically. 

By using the method of "literacy levels" to catego- 
rize people's literacy skills, one may be led to 
conclude that people assigned to a given level of skill 
cannot perform the more demanding types of tasks 
found at higher levels of skill. Yet that is incorrect 
and provides an inaccurate indication of the full 
range of people's literacy skills. Quite possibly, 
people's perceptions of their literacy ability may be 
more accurate than the impressions that might be 
created by the use of the five NALS literacy levels. 



Some M^Jor Findings from the NALS 

The NALS reported data on the literacy scores of 
adults across a wide range of age, for persons with 
special health conditions, for ethnic groups, and for 
incarcerated populations. Some of the key findings 
for each of these groups are summarized below. 

Literacy and Age 

The NALS report indicated that, generally, both 
education and literacy skills increased for adults 
from ages 16-18 up to ages 40*54, and then skills 
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dropped rapidly. Adults 55 -64 and those 65 or older 
performed well below the levels of younger adults, 
even though their average years of education was not 
much different from the 16- 18 year olds. Summariz- 
ing across the three literacy scales, about 44-48 
percent of those adults categorized in Level 1 were 
aged 55 or older, and 32-35 percent were 65 years old 
or older. Some 28-32 percent of those in Level 2 
were 55 years old or older, and 16-18 percent were 
65 or older. 

From the N ALS data it is not possible to say whether 
adults 9 literacy skills rise and then decline or whether 
the various age groups have performed at the levels 
indicated throughout adulthood. This would require 
longitudinal studies. However, referring to the hu- 
man cognitive system of page 4 of this report, the 
N ALS tasks do impose heavier burdens on working 
memory as they increase in difficulty. In fact, this 
may be one of the major reasons the tasks increase in 
difficulty. The authors of the NALS report note that, 
of several variables that might make tasks more 
difficult, two of the variables for prose and document 
tasks are the number of categories or features of 
information that the reader has to process or match, 
and the number of categories or features of informa- 
tion in the document that can serve to distract the 
reader or that may seem plausible but are incorrect. 
In the quantitative tasks, the number of operations 
needed to perform the task is given as a factor that 
may influence the difficulty of the task (Kirsch, et. al, 
1993, pp. 74, 85,&94). 

Generally, holding features or categories of infor- 
mation in short term or working memory and then 
searching through other information places greater 
demands upon working memory, and there is consid- 
erable evidence that working memory performance 
declines with increasing age (Bernstein, Roy, Srull, 
& Wickens, 1988, p. 401). This may explain, at least 
in part, the decrease in literacy skills as age increases. 

As indicated in the human cognitive system model, 
one of the factors that is important for literacy is 
one 9 s organized bodies of knowledge. The bodies of 
knowledge are what makes it possible to compre- 



hend printed displays, to reason analogically (i.e., 
from one body of knowledge to another), and to 
make inferences (i.e., going from the information 
given in the display to another body of knowledge in 
one's mental knowledge base to create yet a third 
domain of knowledge needed to correctly perform 
an inference-type task). Generally, these organized 
bodies of knowledge continue to develop across 
adulthood and tend to resist deterioration in older 
age (Bernstein, et. al, 1988, p. 401). While the 
NALS includes tasks that include knowledge con- 
tent from health, consumer economics, and others, 
it does not systematically assess people's organized 
bodies of knowledge in any domain (e.g., health, 
science, government, etc.). It is not possible to know 
whether poorly performing people's primary prob- 
lems may be their lack of knowledge (e.g., vocabu- 
lary, concepts, etc.) or of working memory control, 
or both. But the rapid decline in performance with 
ages above 55 suggests a strong component of 
working memory control in the NALS tasks. 



Health Conditions 

A major contribution of the NALS was the sampling 
of adults with various forms of physical, mental or 
other health conditions. The survey reported that 1 2 
percent of the adult population reported some type of 
health problem. Significantly, as a type of epide- 
miological indicator of the self-perceived extent of 
adult learning difficulties in the U. S. population, 
some 3 percent (7.5 million) of adults reported that 
they suffered from learning disabilities. Around 60 
percent of these adults scored in Level 1, and some 
22 percent scored in Level 2. Ovfcrall, the average 
scores for those self-reporting that they had a learning 
disabilty were: prose-207; document- 203; and 
quantitative- 200. 

Less than one-half of one-percent reported that they 
were mentally retarded. Eighty-six to 89 percent of 
these adults were placed in Level 1, with average 
scores of: prose- 143; document- 147; and quantita- 
tive- 117. 
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Table 5 


NALS Survey Percentage Levels 






Percentage of race / ethnic group members 




in each of the five NALS skill levels for the prose literacy scale. 






Level 1 


Level 2 


Level 3 


Level 4 


Level 5 


Proficiency 


White 




14 


25 


36 


21 


4 


286 


Black 




38 


37 


21 


4 


0* 


237 


Hispanic: 














Mexican 


54 


25 


16 


5 


0* 


206 


Puerto Rican 


47 


32 


17 


3 


0* 


218 


Cuban 






l / 


£ 

o 


1 

1 


111 

211 


Central / So. 


56 


22 


17 


4 


0* 


207 


America 














Hisp. Other 


25 


27 


33 


13 


2 


260 


Asian / Pacific 


36 


25 


25 


12 


2 


242 


Islander 
















Amer. Indian / 


25 


39 


28 


7 


1 , 


254 


Alaskan Nat. 
























* percentages less than 0.5 rounded to zero. 



Race Ethnicity 

The NALS provides the most extensive data on the 
largest numbers of race-ethnic groups of any previous 
survey. Table 5 shows the percentage of race-ethnic 
groups falling into each of the five levels of the NALS 
prose scales. Large percentages (20-89) of Hispanics 
from the various regions were born outside the 
United States and generally ha i Spanish as their 
primary language. For the most part, the Hispanic 
groups with large numbers born outside the United 
States performed more poorly than Blacks on the 
literacy scales. This is a reversal from the findings of 
the young adult literacy survey. In that survey, 
however, people who could not read English were 
excluded from the survey. Because Hispanics born 
in the United States are more likely to speak and read 
English, their scores are higher on the literacy scales. 
For instance* in the table above, the Hispanic / Other 
category includes those who were mostly (68 percent) 



born in the United States, and their scores are higher 
than the scores for Blacks. Large percentages (78) of 
Asian/Pacific Islanders were also born outside the 
United States. A category of "Other" is also given in 
the NALS report but is not included in Table 5. 

Across the age span, Hispanics (grouped together) 
had fewer years of education (average of 10.2 years) 
than did Whites (12.8) or Blacks (11.6). Through 
ages 55-64 Asian/Pacific Islanders had the most 
years of education (average of 13 years), while 
among those over age 65, Whites had the most 
education. 



Incarcerated Population 

The NALS included a national sample of inmates in 
federal and state prisons. The sample confirmed 
what is widely understood in showing that the 



Adult Literacy in the United State* 



prison population tends to be quite different de- 
mographically than the general adult population. For 
example, the prison population was mostly males 
(94 percent), 80 percent were below the age of 40, 
they were less White (35 percent), more Black (44 
percent) and Hispanic (17 percent), and less well 
educated (49 percent with less than a high school 
education). 

The prison population scored lower on literacy than 
the general adult population. The average scale 
scores for the three literacy scales were: prose-246 
(272 for the general adult population), document- 
240 (267 general adult population), and quantita- 
tive-236 (27 1 general adult population ). In terms of 
the NALS literacy levels, looking across the three 
literacy scales, some 31 to 40 percent of inmates 
were in LeVel 1, 32-38 percent in Level 2, 22-26 
percent Level 3, 4-6 percent Level 4, and less than 
0.5 to 1 percent in Level 5. 

Poverty, Income, Occupational Status, and the 
Intergenerational Transfer of Literacy 

The NALS confirmed other studies going back over 
the decades in showing that the less literate are more 
likely to be found in poverty, on welfare, unemployed 
or employed in poorly paying jobs, and in the lower 
status jobs that require less education (see page 135 
of this report) . 



The intergenerational effects of parent's education 
level on the adult's literacy level was also replicated 
in the NALS • Adults whose parents had completed 
a four year college degree were nine times more 
likely to have completed a college degree themselves 
than were adults whose parents had 0-8 years of 
education (46 percent versus 5 percent).Thirty-two 
percent of adults whose parents had completed 0-8 
years of education had themselves completed only 
0-8 years of education, whereas only 5 percent of 
adults whose parents had completed high school 
reported that they themselves had completed only 0- 
8 years of education. Some caution in interpreting 
these data is called for because the NALS included 
some 16 to 18 year olds who were still in school. See 
pages 127-131 of this document for more on the 
intergenerational transfer of literacy. 
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Listening And Reading In Adult Literacy 



According to the developmental model of literacy 
outlined in the introduction to this Compendium, 
children typically acquire considerable competence 
in listening and comprehending speech before they 
develop competence in reading and comprehending 
the written language. Indeed, the whole idea behind 
the teaching of "phonics" and other "word attack" 
techniques is that the learner's main task is to learn 
how to "decode" the written language to recover the 
spoken language which can then be comprehended 
as usual. 

The idea that listening competence develops first 
and then reading competence permits the learner to 
understand in writing that which could earlier be 
understood only in the spoken language leads to the 
concept of "reading potential." Figure 83 illustrates 
the concept for school children. The general notion 
is that children enter school at the first grade with 
two types of communication abilities: listening and 
reading (there are, of course, other communication 
abilities, but they are not the object of discussion 
here). By definition, the average listening ability of 
first graders is designated as first grade listening 
ability. The average reading ability of first graders is 
designated as first grade reading ability. These are 
the "normative" designations of listening and read- 
ing skills. 

Figure 83 shows the hypothetical case of a child with 
normative listening and reading levels at the second 
grade. However, as the figure illustrates, if the child 
could read as well as he or she listens, then the 
"reading potential" score would be at the third grade 
level. 

The concept of "reading potential" is important for 
adult literacy for at least two reasons. First, whether 
people are designated as "learning disabled" or not 
is generally based on the idea that on some measure, 
such as an "intelligence" test, the people are at their 
appropriate age level or above, but on a reading 
measure they are two or more years behind. In other 



words, they are not reading "up to their potential." 
Listening tests are one way of assessing people's 
"reading potential." 

The second reason that the concept of "reading 
potential" is important in adult literacy education is 
that it is frequently thought that adults in need of 
literacy education have lived a reasonably long time 
and developed fairly high levels of competence in 
oral language, including vocabulary and compre- 
hension ability for listening. Therefore, unlike 
children, whose oral language skills are not well 
developed yet and who must acquire higher levels of 
vocabulary while also learning to read, adults will be 
able to acquire a fairly high level of literacy in a brief 
time, relative to that required by children. This leads 
to the expectation that the adult's literacy problems 
may be solved fairly quickly with a relatively brief 
period of training in some form of decoding the 
written word to recover the vast amount of compe- 
tence already possessed in the oral language. 

However, as the data for Figure 84 indicate, when 
some 2,000 adults were assessed to compare their 
skills in both listening and reading, the anticipated 
higher level of listening ability, particularly at the 
lower levels of reading as indicated by the Gates- 
MacGinitie reading test, did not emerge when lis- 
tening to comprehend paragraphs. While the vo- 
cabulary tests did show greater skill by listening, it 
appears that that was due to the fact that in the 
listening vocabulary test, the test was administered 
both by listening and by reading. In this case, then, 
people were paced to complete the entire vocabulary 
test by the spoken words on the listening test. This 
appears to have provided an indication of greater 
vocabulary ability than when vocabulary was as- 
sessed only by reading. 

The data of Figure 84 were obtained using group 
administered tests in which the listening and reading 
measures were equated as closely as possible in 
content, time to listen or read, and difficulty of the 
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questions, which were all multiple-choice requiring 
recall of factual information. 

The chapter by Sticht and James (1984) provides an 
extensive review of listening and reading studies 
with adults. In one study, using the same test as used 
to obtain the data in Figure 84, an incarcerated prison 
population of men reading at the 4th grade level 
showed about 1.5 grade levels of "potential" as 
derived in Figure 83. 

Using adif ferent group administered test of listening 
and reading skills, the Durrell Listening and Read- 
ing Series tests, Sticht (1978) reported that for 71 
native speakers of English who were in an adult 
literacy program their average reading level was at 
the 4.8 grade level, while their reading "potential" 
(listening transformed to reading as in Figure 83) 
was 6.0. Interestingly, for 45 adults with English as 
a second language, their reading score was 4.8 while 
their reading "potential" score was at the 4.4 grade 
level. In other words, their listening skills were 
lower than their reading skills, so when the listening 
score was converted to a reading "potential" score, 
they performed below their actual reading level. 

Using the Diagnostic Reading Scales, which are 
administered one-on-one as an individual test, Sticht 
& Beck (1976) assessed the reading "potential" of 42 
native English speakers and 32 English as a second 
language speakers in an adult literacy program. The 



native speakers had an average reading level at the 
6.2 grade level and a "potential" at the grade 6.4 
level. The non-native English speakers read at an 
average 4.3 grade level and had a "potential" at the 
4.4 grade level. 

Generally speaking, as the data of Figure 84 and the 
studies cited above suggest, adults with lower levels 
of literacy tend to also have lower levels of oral 
language (listening) comprehension. This appears to 
be true for both vocabulary knowledge and the 
comprehension of connected discourse. Of course, 
there can be important exceptions to these general 
trend data. But as a rule, these data on listening and 
reading suggest that adult literacy educators will 
have to provide extensive opportunities for adult 
learners to develop considerable bodies of knowl- 
edge to improve both their oral and written language 
comprehension skills to the higher levels. 
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Figure 83 



Listening And Reading • The "Reading Potential" Concept 




1 2 3 4 5 6 7 
Grade Level 



A - Indicates the normative listening score for the 2nd grade, called listening at the 2nd 
grade level. 

B - Shows the normative reading score for the 2nd grade, called reading at the 2nd grade 
level. 

C - Shows conversion of the normative listening score to a reading "potential" score by 

drawing a horizontal from A to intersect with the reading curve, and then dropping a 
perpendicular line to the abscissa. 

The example shows a reading potential score of 3rd grade. 

Thus, the case illustrated shows a person listening and reading at the 2nd grade level, with a 
reading potential score of 3rd grade level. 
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Figure 84 



Listening And Reading - Gates / MacGinitie 
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Listening and Reading test performances of applicants for military service on the Air Force's Literacy 
Assessment Battery (LAB). Data are presented for the Vocabulary and Paragraph subtests of the 
LAB. Except for those applicants who scored at the 2nd grade level on the Gates - MacGinitie reading 
test, average scores were higher for reading than listening. 

Source- Stick.T.Hc4*e,L.&Caylor.J. (1982. March). Uimcy.Oricy.andVocatwnal Aptit^ 

Services. Professional Paper 2-82: Alexandria. V A: Human Resources Rea^Orpnizarion. 




THE INTERGENERATIONAL 
TRANSFER OF LITERACY 
FROM PARENTS TO CHILDREN 

A consistent finding across ail the adult literacy 
surveys from 1917 to 1992 reviewed in Part 1 is that 
the more education people have, the more reading of 
books, magazines, and newspapers they do, and the 
more highly skilled they are. 

In this section of the Compendium, we introduce 
another salient finding across adult literacy surveys 
for the last quarter of a century. People with more 
highly educated parents are, themselves, likely to 
become the more highly educated, more extensively 
read, and highly skilled of the next generation. 

Regarding the relationship between parent's edu- 
cation and the next generation's reading skills, Fig- 
ure 85 shows reading skill data for 9, 13, and 17 year 
olds as well as young adults 25-35 years old. These 
data were obtained by the National Assessment of 
Educational Progress (NAEP) in the early 1970s 
(see sources cited at Figure 85). In the NAEP survey, 
children and adults were tested on 8 different reading 
"themes" or skill areas, ranging from word meanings 
(vocabulary knowledge) to critical reading. As Fig- 
ure 85 shows, regardless of the type of reading skill 
assessed, and at all ages, as parent's education in- 
creased, reading proficiency increased. 

In Figure 86, data from the 1985 survey of young 
adult literacy skills are presented showing profi- 
ciency on the NAEP Prose literacy scale (see page 



1 29). The figure shows parent 9 s education levels on 
the horizontal (X) axis and the young adult's own 
years of education inside the figure. For instance, for 
parents with only 0-8 years of education and their 
adult children with only 0-8 years of education, the 
average Prose literacy score is 233. As the parent's 
education level increases, there is not much im- 
provement in the proficiency of young adults with 
only 0-8 years of education. However, as the young 
adult's own education increases from 0-8 years of 
education, to some high school (HS), to post high 
school and to possession of a college degree, there is 
an interaction with parent's education level. The 
greater the parent's education and the greater their 
adult children's education, the higher the reading 
proficiency. 

Figure 87 shows the relationships of mother's edu- 
cation to performance on the Armed Forces Quali- 
fication Test of 1980 for Whites, Hispanics and 
Blacks. Similar data are presented in Figure 88 for 
the 1985 NAEP survey of young adult literacy skills. 

The data on the intergenerational transfer of literacy 
from parents to their children has provided a large 
part of the evidence to argue for "intergenerational 
literacy" or "family literacy" adult education pro- 
grams. Today, both the federally-funded Head Start 
and Even Start programs aim to promote the 
intergenerational transfer of literacy from parents to 
children through family literacy programs. 
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Figure 85 



Median Percentages of Success for Parental Education by Themes | 
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Data From the National Assessment of Educational Progress Showing Relations of 
Parent Education Level to Reading Task Performance 



Source: Hmk^Aitmmtmtf&kKM^PrvytaL Prdinicwy Report 02-R-00 Reeding Sumrrery, 197Z Washington, PC: U. S. Department 
of Education, pg*J2, 21 105. and 145. 
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Figure 86 



Performance Of Young Adult And Parental Education 
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Performance of Young Adults (21-25 years of age) on the 1985 NAEP Prose Scale 
of Reading Proficiency as a Function of Parental Education 
(higher of mother's or father's) and the Person's Own Years of Education 



Source: Kitsch. I. and Junfebtut, A. (1986, September). Literacy: Profile* of American Young Adults. Final Report Princeton, NJ: 
Educational Testing Service. National Assessment of Educational Progress, (pp. C-22. 2?). 
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Figure 87 



Armed Forces Qualification Tests - 1980 



Department of Defense 
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Performance of Blacks, Hispanics, and Whites on the 
1980 Armed Forces Qualification Test of Reading (Word Knowledge and 
Paragraph Comprehension) and Mathematics (Numerical Operations and Arithmetic 
Reasoning - Word Problems) as a function of Mother's Education Level. 



Source: Profile of American Youth: 19S0 Nationwide Administration of the Armed Services Vocational Aptitude Battery. ( 1982, March). 
Washington. DC: U. S. Department of Defense. Office of the Assistant Secretary of Defense (Manpower. Reserve Affairs, and 
Logistics.). Table C-3.p.79. 
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FIGURE 88 Mother's Educational Level And Performance Of Young Adults 
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Performance of Blacks, Hispanics, and Whites 
on the 1985 NAEP Reading Proficiency Prose Scale 
as a Function of Mother's Education Level 



Source: Kinch. I. and JungeWut. A. (1986. September). Literacy: Profiles of American Young Adults. Final Report. Princeton. NJ: 
Educational Testing Service. National Assessment of Educational Progress, (pp. C-26). 
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LITERACY, OCCUPATIONAL STATUS 
AND JOB PERFORMANCE 

Relationships among "intelligence," "aptitude/' and 
"achievement" test scores, such as literacy tests, and 
occupational status have been repeatedly studied 
over the last seventy-five yeats. Tae data presented 
in Figure 89 illustrate the trends in such studies. The 
upper part of the figure shows data from World War 
I in which "intelligence" and occupational status 
was studied. The tests used to measure "intelli- 
gence" were the Army Alpha and Beta tests discussed 
in Part 1 of this Compendium. 

The bottom part of Figure 89 shows data from the 
1986 survey of young adult literacy skills ( see pages 
99 through 1 12 of this Compendium) relating "lit- 
eracy" to occupational status. The trends for 1917 
and 1986 are similar, whether one calls the tests 
measures of "intelligence" or of "literacy," laborers 
tend to perform more poorly than sales or clerical 
workers who, in turn, perform more poorly than 
technical and professional workers. 

Figure 90 presents data from the 1986 study of the 
literacy skills of young adults in relation to the 
number of jobs that are projected to be available in 
the year 2000. It shows that there are large differences 
in the percentages of Whites, Hispanics and Blacks 
who possess literacy skills at or above the level of the 
typical clerical worker in the young adult population. 

Figure 91 shows relationships of years of education 
and ethnicity to proficiency on each of the three 
literacy scales of the 1986 young adult literacy 
survey, A disturbing finding is that the average 
proficiency on each of the three literacy scales of 
Black college educated young adults is slightly 
below that of White high school graduates. More 
important, however, is the finding that the average 
Black college graduate possesses proficiency in 
literacy below the average proficiency of young 
adult clerical workers. This is true across all three 
literacy scales. Together, the data of Figures 90 and 
9 1 suggest that Blacks, including college graduates, 
will find it difficult to compete with Whites and 



Hispanics for managerial, technical and professional 
jobs in the foreseeable future. 

Literacy, Job Knowledge and Performance 

While there are repeated studies of education, intel- 
ligence, aptitude, and achievement and occupational 
status, there are very few sources of information 
regarding the relationship of literacy to actual job 
knowledge and job performance. Figure 92 presents 
data from military studies showing relationships 
among reading, job knowledge and jobperformance. 
In this work, a commercially available, standardized 
reading test was used to measure reading skill levels 
expressed in "reading grade levels/' For instance, a 
reading level of 6.5 means that a person has scored 
on the reading test like the typical child in the 5th 
month of the 6th grade. 

Job Knowledge tests were paper-and-pencil, mul- 
tiple-choice tests of job knowledge that supervisors 
and job incumbents said was essential knowledge 
for performing the job. Job Performance tests were 
actual job tasks that were performed in a "hands-on" 
manner. For instance, Cooks cooked scrambled eggs 
and other things, Supply Specialists filled-out sup- 
ply orders, automobile Repairman repaired bleeding 
brakes and performed other repairs to broken vehicles, 
and so forth. 

Figure 92 shows that reading is related to both Job 
Knowledge and Job Performance test performance. 
For instance, in the Supply Specialists job, on the 
hands-on, Job Performance test, 66% of workers 
with reading skills in the 4*5.5 level performed in the 
bottom quarter of performers. On the other hand, 
56% of workers with reading skills at the 11-14.5 
grade levels were in the top 25% of job performers. 
These figures show that, even though correlation 
coefficients may be low (ranging from .26 for Re- 
pairman to .40 for Supply Specialists on the hands- 
on, job sample tests; and from .40 for Supply Spe- 
cialists to .57 for Armor Crewman), the quarter 
distributions reveal considerable relationships of 
reading to job proficiency, particulary at the lowest 
and highest levels of reading. 
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Figure 93 shows these relationships in a different 
manner. There the percent of job incumbents who 
scored 50% or better on the Job Knowledge and Job 
Performance tests for Mechanics (Repairmen), 
S upply Specialists, and Cooks is presented for people 
having increasing levels of reading skill. These data 
support those of Figure 92 in showing strong rela- 
tionships of reading ability to job proficiency (see 
especially the solid, black lines in Figure 93 that 
average over the three jobs). 

A final, important finding from these military studies 
is summarized in Figure 94. That figure shows how 
the performance of Supply Specialists and Repair- 
man improved on the hands-on, Job Performance 
tests as both a function of increasing reading ability 
(the horizontal axis) and whether or not the person 
used the available technical manuals while per- 
forming the job sample test tasks (upper, solid curve). 
This figure is unique in showing that job performance 
may increase as both a function of having a higher 



level of reading skill and of actually using that skill 
while performing a job task. 

Taken together, the data on literacy, occupational 
status and job performance indicate that both the 
types of occupations for which people are likely to 
qualify and the job proficiency they are likely to 
exhibit in the job they get may be related to their 
levels of literacy. The relationships are not perfect, 
far from it, yet the trends are there, and they have 
been there for some three-quarters of this century. In 
the absence of major changes in the manner in which 
society allocates work and workers to jobs, and to the 
extent that increased educational levels do not lead 
to greater literacy proficiency for minorities, it is 
likely that these trends will last far into the next 
century. This will pose considerable economic du- 
ress on the underskilled, particularly African- 
Americans, but Hispanics and poorly educated and 
less literate Whites, too. 
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Figure 89 



Intelligence, Literacy and Occupations 
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This figure shows that whether one calls adult cog- 
nitive skills "intelligence^ as in 1919 during World 
War I, or "literacy/* as in 1986 when the profiles of 
young adult literacy were published, the distribu- 
tions of cognitive skills in different occupational 
categories remains the same. The least skilled are 
found more often in the lower-status, lower paying 
occupations, which typically demand less education, 
while the more highly skilled are found in the higher- 
status, better paying, more educationally demanding 
occupations, interestingly, during World War I, over 
30% of laborers had their "intelligence" assessed 



using the Army Beta test for illiterates or non- 
English speakers (see Part lof this Compendium). 
The 1985 young adult literacy survey used a literacy 
test for all those surveyed (non-English speaking 
were excluded). The fact that a literacy-based test 
could be given to almost all young adults, including 
laborers, in 1985 reflects the fact that considerable 
gains have been made in rendering the population 
literate in the last three-quarters of a century. Despite 
this, the least skilled still occupy the lower rungs of 
the occupational ladder. 
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Figure 90 



Prose, Document, and Quantitative Literacy Levels 
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Kirsch and A. iungeblut (1986. September). Literacy: Profiles of America's Young 
Adults. Final Report. Princeton, NJ: National Assessment of Educational Progress at 
Educational Testing Services, pp. lV-i5,Rgure4.lJV-I8»Hgure4.2,andIV-2I, Figure 

4.3. 



Source: For average scale score, (300) for Clerical workers on the Prose, Document and 
Quantitative Scales is P. Barton and I. Kirsch. (1990, July). Workplace competencies: 
The need to improve literacy and employment readiness. Washington, DC: U.S. Govt. 
Printing Office, p. 14, Table 1 . 



Reading this figure from left to right shows that in 
the year 2000, there will be over 17 million profes- 
sional jobs, some 22 million clerical jobs, and just 
over 4 million laborer jobs (the data excludes 3.9 
million forestry jobs because there were no corre- 
sponding data on job holders and their literacy skills 
for this category in the sources summarized). While 
about 53% of jobs are in fields with skill levels below 
that of the average clerical worker, some 56*57% of 



young adults have skill levels in Prose, Document, 
and Quantitative literacy above that level. However, 
while two-thirds or more of Whites and 37-41% of 
Hispanics possess skill levels above the average 
level of clerical workers, only one in four or five 
Blacks have literacy skills above the average for 
clerical workers. This means African-Americans 
will tend toqualify mostly for the lower status, lower 
wage jobs of the next century. 
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® Mean proficiency scores on the NAEP Document Scale of full-time workers, age 21-25. by occupational group: 1 986. Source: P. Barton 
andl.Kirsch. (1990,July). Workplace competencies: The need to improve literacy and employment readiness. Washington, DC: U.S. 
Govt. Printing Office, (p. 14, Table 1). 

® Source: I. Kirsch and A. Jungeblut ( 1 986. September) Literacy: Profiles of America's Young Adults. Final Report. Princeton. NJ: National 
Assessment of Educational Progress at Educational Testing Services, (pp. CI 2, 13). 



The relationships among amount of education, lit- 
eracy skills of young adults of different ethnic groups, 
and average literacy skills of occupational groups 
(far right-hand side ) are shown in this figure. For all 
ethnic groups, literacy development is clearly related 
to amount of education. However, for similar amounts 
of education, the ethnic groups differ greatly in 
amount of literacy skill achieved. Both Hispanic and 



Black high school graduates score well below the 
average skill level of clerical workers, while White 
high school graduates score above that level. Indeed, 
with average scores slightly below 260 on each 
literacy scale, African-American high school 
graduates score well below the average skill level of 
around 270 for laborers. 
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Job Knowledge and Performance 



Literacy in Relation to Job Knowledge and Performance 



Quarter Distributions of Job Knowledge and Performance by 
Reading Grade Level: Comparison of Four Jobs 
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Source: Sticht,T. (Ed.). (1975). Rttduig for Working: A Functional Literacy Anthology. Alexandria. VA: Human Resource* Research 
OrganiMion. (p.69). 
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Literacy, Job Knowledge and Performance 
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Source: StichtT. (Ed.). (197S). Reading for Wotking: A Functional Literacy Anthology. Alexandria, VA: Human Reeowcet Research 
Organization, (p.l 16). 
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Figure 94 



Performance as a Function of Reading Ability 



Job Sample Test Performance as a Function of Reading Ability and 
Use of Technical Manuals 
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Source: Sttcht, T. (Ed). (1975). Reading for Working: A Functional Literacy Anthology. Alexandria, VA: Human Resource* Research 
Organization. (pM). 



This figure depicts perhaps the strongest evidence 
for the importance of literacy in job performance. 
The figure shows three groups of military workers 
having reading grade levels of 4-6.9, 7-8.9, or9-l 1.9 
on the horizontal axis. There are two typesof workers. 
Supply Specialists and Automobile Repairman (me- 
chanic). The filled points show how well workers 
performed actual job sample tasks in a test situation. 
The performance of Supply Specialists increased 
from around 42% for those reading in the lowest 
group, to 48% for those reading above the 9th grade 
level. The Repairman data show no relationship to 
reading. These differences in Supply Specialist and 
Repairman may reflect the fact that the Supply 
Specialists job tasks are inherently demanding of 
reading to complete forms, requisitions, etc. while 
the Repairman's tasks, such as adjusting the carbu- 



retor, repairing the brakes, etc. do not inherently 
demand reading. However, as the data points indi- 
cate, when cither Supply Specialists or Repairman 
used the available technical manuals to aid in the 
performance of their job tasks, proficiency increased 
across all three reading groups. The top, solid line 
shows the average for the two jobs. The effects of 
both having higher levels of reading skill and using 
that skill on productivity as measured by the per- 
formance of actual job tasks can be seen by comparing 
the average correct scores of those in the lowest 
reading group who did not use their manuals (aver- 
age of 45% correct), to that of those in the highest 
reading group who did use their manuals (average of 
about 65% correct). This represents about a 20% 
increase in productivity due to both having and using 
higher levels of literacy (reading). 
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PART 3 

Testing Of 
Adult Literacy Development 
In Education Programs 

california's federally funded adult 
Basic Education Programs 

The Illinois Study Of Literacy Programs 
The Literacy Assistance Center In New York City 
A Summary Of Gains In Sixteen Local Programs 

Longitudinal Studies 
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CALIFORNIA'S FEDERALLY FUNDED 
ADULT BASIC EDUCATION PROGRAMS 

The U. S. Department of Education funds adult basic 
education programs in the various states. The fed- 
eral government requires that states receiving federal 
funds report data on achievement gains made by 
adult learners in the programs. The data presented in 
Figure 95 are pre-test and post-test scores for federally 
funded (section 321) adult basic education (ABE) 
programs in California for fiscal years 1985-86 
through 1991-92. 

California uses the Comprehensive Adult Student 
Assessment System ( CAS AS) to measure gains for 
low (A), middle (B) , and higher ability (C) learners 
in a sample of the federally funded 321 ABE pro- 
grams. The CASAS assesses reading (among other 
things) using "functional literacy "real world" 
tasks similar to those reviewed in Part 1 Of this 
Compendium in every study from Buswell's 1937 
work to the most recent young adult and national 
adult literacy surveys by the NALS. However, 
unlike the NALS, in which respondents must con- 
struct their responses, the CASAS uses multiple- 
choice tasks in which respondents select the correct 
response from alternatives* Because of this, guess- 
ing has a higher probability of affecting CASAS 
scores than NALS scores. 

The CASAS also differs from the NALS adult lit- 
eracy surveys in that to be assigned to a given ability 
level on the CASAS, adults must have a 50% 
probability of being able to perform a task that is at 
the same level of difficulty. For instance, to score at 
the skill level of 215 on the CASAS means that a 
person has a 50% chance of being able to perform all 
items that are at the 215 level. They have a greater 
than 50% chance of performing items below the 215 
level, and less than a 50% chance of performing 
items above the 215 difficulty level 



On the NALS adult literacy surveys, the standard for 
being assigned a skill level is that a person has an 
80% probability of being able to perform tasks that 
are at that difficulty level. For instance, an ability 
level of 215 on the NALS literacy surveys means 
that people at that level have an 80% probability of 
being able to perform tasks at the 215 level of 
difficulty. Because the standard for performance is 
higher on the NALS adult literacy surveys than on 
the CASAS, the NALS is likely to assign more 
people to lower literacy levels than will the CASAS. 

When assessing the reading skills of California's 
ABE students, pre-tests are given at the beginning of 
the program, and post-tests are administered fol- 
lowing some 80-120 hours of instruction. Thus the 
gains shown in Figure 95 are for learners who have 
had about 100 hours of instruction on average. 

The data of Figure 95 show that, despite some fairly 
wide-ranging shifts in pre-test scores, resulting to 
some extent from changes in population and data 
sampling procedures, learners at each of the three 
ability levels consistently make about 3-5 points 
improvement in 100 hours of instruction. This 
translates, roughly, to about a half to one "year" of 
gain in reading grade levels (CASAS does not report 
scores in reading grade levels, so those given are 
approximations from studies to which CASAS acores 
were correlated with scores from the Tests of Adult 
Basic Education - TABE). 

In the California ABE programs in 1991-92, those 
entering at the 192 level made about a five point gain 
in 100 hours of instruction. By extrapolation, if the 
goal is set at having all adult basic education students 
reach a standard of 230 in reading (roughly the 10th 
grade level), then since (230 - 197 = 33) and (33/5 
points of gain = 6.6) one may estimate that some 660 
hours of instruction will be needed for level A 
students to achieve the 230 criterion on the average 
- if the rate of gain is constant across all hours. 
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Presently, most ABE students leave the program at 
the end of 120 hours of instruction, and there are no 
follow-up procedures to determine how many stu- 
dents may have enrolled in ABE programs, dropped- 
out and then returned at a later date. California is 
moving to introduce such follow-up procedures 



through the use of an electronic card, similar to an 
automatic teller machine (ATM) card that adult 
students will keep with them and use to obtain adult 
education. The card will permit the tracking of 
people, courses taken, and development in literacy 
ability over time. 
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Achievement Gains For California Programs 
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Sources: Dtu for yean 19S546 through 1989*90 taken from M CASAS Statewide Accountability System for federally Funded 32 1 Adult Basic Education 
Programs: July 1 . 19S9 - June 30, 1990. M p. 40 Table 5. prepared for theCalifornia Department of Education. August 1990. Data for years 1990-91 through 
1991-92 taken from "Student Progress and Goal Attainment in California's Federally Funded ABE Programs: July 1.1991 to June 30. 1992." p. 37. Table 
6.4. prepared for the California Department of Education. August 1992. Approximate reading grade level scores for CASAS scale scores calculated using 
T. Stkht (1990. January). Testing and Assessment in Adult Basic Education and English as a Second Language Programs. Washington. DC: U.S. 
Department of Education. Division of Adult Education and Literacy, p. 35. Table A-3. 
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THE ILLINOIS STUDY 
OF LITERACY PROGRAMS 

A report of reading gains made in 23 literacy programs 
in Illinois for fiscal year 1988 provided the data for 
Figure 96. The 23 programs included six Laubach 
Literacy Action programs, four Literacy Volunteers 
of America programs and thirteen "eclectic" pro- 
grams. These programs were funded by the Illinois 
Secretary of State's Literacy Projects office and 
conducted by a variety of community groups, in- 
cluding non-profit organizations, community col- 
leges, libraries, and public schools. The 23 programs 
were selected to be representative of 89 programs 
serving 16,400 students in Illinois in fiscal year 
1988. 

The test used to assess reading gain was the Slosson 
Oral Reading Test (SORT), a test that assesses word 
identification without assessing understanding of 
meaning. Scores on the SORT are reported in reading 
grade levels. The adult students were assessed at the 
beginning of the programs and then again every 



three months for a year. The SORT was used repeat- 
edly, and hence some practice effects may have 
influenced gain scores. The first test was called the 
pre-test, and the repeated examinations given every 
three months were called post-test 1 , post-test 2, and 
post-test 3. The data of Figure 96 include the pre-test 
and post-test 1 data to provide improvement scores 
comparable to the California and New York data of 
Figures 95 and 97. The hours of instruction between 
the pre-test and post-test 1 ranged from 1 to62.5.The 
data obtained with repeated post-testings are given 
in Figure 99. 

As Figure 96 indicates, there are large variations in 
the gains achieved in various programs, program 
number 1 7 made the largest gain, 1 .4 "years", in 25.5 
hours, while program number 9, with 32 hours of 
instruction made only .6 **years" gain. On the aver- 
age, about 6.5 "months" of gain were made in some 
36 hours of instruction between the pre-test and post- 
test 1. Generally, amount of improvement does not 
appear to be associated with hours of instruction. 
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Figure 96 
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Reading Gains 
3 4 5 



6 



Instructional 



Hours of 



Program 


N 


Instruction 


1 


21 


23.8 


2 


102 


39.0 


3 


52 


40.0 


4 


122 


17.0 


5 


57 


54.3 


6 


46 


29.0 


7 


150 


17.0 


8 


76 


14.0 


9 


113 


32.0 


10 


204 


21.0 


11 


87 


21.0 


12 


34 


26.0 


13 


58 


62.5 


14 


128 


40.0 


15 


82 


33.0 


lo 


to 


1 A 


17 


35 


25.5 


18 


29 


20.0 


19 


41 


30.0 


20 


98 


20.0 


21 


222 


22.0 


22 


138 


22.5 


23 


37 


21.0 



•0 



3 4 5 
Grade Level Scores 



Slosson Oral Reading Test • Pre -Tests Q Post -Tests 



Sources: Bowren,FayF.,etal. (1990. April). An evaluation of reading gains within Illinois literacy pcojecU: FY 1988. Illinois: Secret*? of State. Su* 
Librarian. Pre-test scores are medians from the table on page 9t post-test scores are ore-test scores plus the post-test I median gain scores from the table 
on page 100. Summarized over programs, the median pre-test score is 3.3, median gain is +.65. giving a median post-test score of 3.95. 
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THE LITERACY ASSISTANCE CENTER 
IN NEW YORK CITY 

The Literacy Assistance Center (LAC) in New York 
City provides centralized support services to literacy 
provider agencies in the city. These agencies pro- 
vided literacy instruction to more than 50,000 adult 
students in 1989-90. Of these students, over 20,000 
(37%) were enrolled in adult basic education, the 
remainder were in English language courses. 

All the provider agencies in the New York City 
Literacy Initiative submit data on demographics of 
learners and instructional factors to the LAC. The 
instructional factors include data on the number of 
contact hours and the pre- and post-test scores of 
students* The test used to measure reading skills is 
the Test of Adult Basic Education (TABE). The 



LAC prepares reports showing several ranges of 
entry level scores of learners and the gains they make 
in the program during the year. 

Data for five years (1985-86 through 1989-90) are 
presented in the figure below. For this figure it was 
necessary to assume that the pre-test scores were at 
the midpoint of each of the entry ranges. For instance, 
in the range of entry scores from 3 to 4.9, the pre-test 
score for each year was assumed to be 4.0. For the 
lowest range, scores less than 3.0, the entry score 
was assumed to be 2*0 for each year* 

As the figure indicates, setting aside the data for 
1 985-86, which was the first year data were obtained 
and reported by the LAC, learners made about a 
"year" of gain on the TABE regardless of the entry 
level scores* 
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New York City Literacy Initiative: Achievement Gains 
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Sources: The New Yoric City Adult Literacy Initiative: Analysis of New York City's 1989*1990 Adult Literacy Data Bate. Prepared for the Literacy 
Assistance Center, Inc. by Metis Associates. October 1991 , p. 40, Table 29a. Pre-test score for participants entering with reading grade levels below 3.0 
(< 3.0) was assumed to be 2.0 For participants in the other ranges of entering scores, Pre-test scores were assumed as the mid-point of the interval. Total 
N's are shown in this graphic. However, actual numbers of pre- and post-test scores were fewer than half the N's given for 1919-90. for instance. Actual 
N*s for pre- post-tests were not given in Tables 2ta or 29a of the cited report. 
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A SUMMARY OF GAINS 
IN SIXTEEN PROGRAMS 

Data on pre- and post-tests for sixteen programs 
from different parts of the United States are sum- 
marized in Figure 98, More extensive information 
on the various programs is available in the sources 
cited below. The programs depicted were not chosen 
for any particular reason, they simply represent an 
odd lot of programs in reports ranging from 1982 to 
1992. They measured reading skills using five dif- 
ferent tests, though most used the Tests of Adult 
Basic Education (TABE). 

Programs in the sources numbered 8, 9, 12, 14, and 
16 below were designated as "exemplary" by the 
U.S. Department of Education' s Joint Dissemination 
Review Panel Programs 6 and il used computer- 
based instruction. Program 1 summarized data from 
several hundred sites across the nation that used the 
Comprehensive Competencies Program (CCP). 
Programs 5, and 7 were offered in Job Corps centers. 



Programs 3, 4, and 13 were offered in penal institu- 
tions. It is apparent from Figure 98 that there is little 
relationship among entry level scores and gain or 
hours of instruction and gain. The 82 hours of 
instruction in program S produced more gain than 
the 185 hours of instruction in program 16, but about 
the same gain as the 49 hours of instruction in 
program 6. Gain in the 1979 JCARP (program 14) 
was about 1 "year," while the JCARP of 1981 
(program 9) reported 1.5 "years" gain. However, the 
JCARP did not follow the standardized procedures 
for the Tests of Adult Basic Education (TABE) and 
hence the accuracy of pre- and post-test scores and 
the reliability of the gain is suspect. 

Across the sixteen programs, improvements in adult 
literacy skills ranged from about 0.5 to 1.5 "years" of 
gain in anywhere from 20 to 229 hours of instruction 
using a variety of measures. In general, these gains 
are in the same range as those summarized earlier for 
California, Illinois, and New York City. 



Table 6 



Sources For Achievement Gains - Figure 98 



1. CCP 

Z TFLP 
3,4 Meyer 



R. Taggart (1986, July). The Comprehensive Competencies Program: A summary. Alexandria, V A: Mean entry reading grade level 
of 7.9 extracted from Summary Table 20, p. 37; N it sum of enrolket from 1984 through the first quarter of 1986, Summary Table 
6, p. 28; post-test score obtained by adding 1 .0 reading gain for all termtnees in Summary Table 25, p. 42 to entry mean score of 7.9. 

National Center for Family Literacy (1994). The Power of Family literacy: Louisville, KY, p. 14. 



L 

No 



Meyer, J. Ory and R. Hinckley. (1983, December). Evaluation research m basic skills with incarcerated adults. Technical Report 
>.303. Center for the Study of Reading. Urbana,IL: University of Illinois. Table 2. 

5. Job Corps Job Corps in Brief: Program Year 1991(1 July 1991 -30 June 1992). Washington, DC: U. S. Department of Labor, Employment 
and Training Administration, Job Corps. Entry score of grade 7.0 from p. 15; gain of L4 grade equivalents from p. 2 1 added to 
7.0 to derive post-test score of 8.4. 

6, 7 Gcller D. Geller and M. Shugall (1983, April). The impact of computer-assisted instruction on disadvantaged young adults in a non- 
traditional educational environment Reston, VA: Advanced Technology, Inc., p. 16, Table 3: students with 1st post-test. 

8, 9, 14 JCARP S. Darling (1982, September). Adult education projects that work: Jefferson County (Kentucky) Adult Reading Program, 

Louisville, KY: Jefferson County Board of Education, Paper submitted to the U. S. Department of Education, Joint Dissemination 
Review Panel, p. 8, Table 6. 

10, 12 F.I.S.T. I. Saltiel (1983, March). Adult education projects that work: Project F.LS.T. Edison, NJ: Project F.l.S.T. Paper submitted to the 
U. S. Department of Education, Joint Dissemination Review Panel, p. 7, Table 3. 

1 1 Askov R Askov, C. Maclay, and B. Bixler (1992). An intergene rational study of the impact of computer-assisted instruction with low- 

literate parents. In: T. Sticht, M. Beekr, and B. McDonald (Eds.) The Intergene rational Transfer of Cognitive Skills. Volume 
1: Programs, Policy, and Research Issues. Norwood, NJ: ABLEX Publishing Corporation* p. 153. Table 12.1. 

13 Gold P. Gold and P. Horn (1982). Achievement in reading, verbal language, audingjocw of control of adult illiterates in a volunteer 

tutorial project. Baltimore, MD: The Johns Hopkins University, p. 14, Table 2. 

15 HF H. Fingeret and S. Danin (1991, January). "They really put a hurtin* on my brain": Learning in literacy Volunteers of New York 

City: Executive Summary. Durham, NC: Literacy South, p. 30. 

16 BES J. Deveraux (1985, February). BES adult literacy project. New York: Bronx Educational Services, Inc. Paper submitted to 

the U.S. Department of Education, Joint Dissemination Review Panel, p. 7. 
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I Figure 98 



Adult Basic Education Programs: Achievement Gains 
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L OOP 198436 c 8,461 32 

2. TFLP 1992-93 c 500 
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7. Gefler 198243d 56 48 
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Skill in Reading - Grade Level Equivalents • Pre - Tetis o Post - Tests 



a Woodcock Reading Mastery Test 

b Adult Basic Learning Exam 

c Tests of Adult Basic Education 

d Stanford Achievement Test 

e Slosson Oral Reading Test 
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LONGITUDINAL STUDIES 

Finding systematically gathered and reported data 
on pre- and post-test scores in adult literacy programs 
is rare enough, but finding data in which adult 
literacy students have been repeatedly post-tested to 
determine their growth in literacy ability over time is 
extremely rare. 

Figures 99 and 100 present two rare sets of data from 
programs in which learners were repeatedly assessed 
over time. Figure 99 reports data for 765 learners in 
Illinois who were assessed as part of the Illinois 
Literacy Project (see page 146 of this Compendium 
for additional information about this project). The 
learners were from 23 different programs that used 
Literacy Volunteers of America, Laubach Literacy, 
or "eclectic" approaches to literacy instruction. The 
adult learners were tested repeatedly using the same 
form of the Slosson Oral Reading Test. So some 
practice effects are possible. As Figure 99 shows, 
most improvement was made between the pre-test 
and the first post-test. Overall gain from the pre-test 
to the last post-test was about 1.4 "years." 



Figure 100 presents longitudinal data from the Lit- 
eracy Assistance Center in New York city for adult 
literacy learners who were enrolled for either two or 
three years (see pagel47 of this Compendium for 
additional information about this project). Learners 
were assessed using different forms of the Tests of 
Adult Basic Education (TABE). The figure shows 
that most improvement occured between the pre-test 
and the first post-test, a finding similar to that of the 
longitudinal data for Illinois (Figure 99).The most 
improvement was made by those students who pre- 
tested at the 1.5 reading grade level. They gained 
about 2.0 * i years- ,f 

Both the Illinois and New York city data suggest 
that, following the first gain from the pre-test to post- 
test 1, subsequent improvement occurs at a lower 
rate. Clearly, assuming everything else stays the 
same, for students in these studies who score at the 
lower levels on the pre-tests (below the 4th grade), 
several years of study would be necessary for them 
to achieve at the 9th grade level or above. 



FIGURE 99 Illinois Literacy Projects: FY 88 Longitudinal Achievement Gains 
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FIGURE 100 I New York City literacy Initiative: Longitudinal Achievement Gains 
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Two Year Cohort 
Three Year Cohort 



(N*2 t 055) 
(N»797 ) 




Pre- End of End of End of 
Tests Yearl Year 2 Year 3 

Time of Achievement Testing 



Longitudinal Analysis of 
Mean Achievement 
(Grade Levels on the 
Test of Adult Basic 
Education - TABE) for 
students in New York 
City's Adult Literacy 
Initiative Programs who 
had attended either two 
(O), or three (•) years. 



Sources: The New York City Adult Literacy Initiative: Analysis of New York City's 1989-1990 Adult Literacy Data Bate. Prepared for the Literacy 
Assistance Center. Inc. by Metis Associates, October 1991, p. 53, Tables 43 and 44. Pre-Test scores for the three-year cohort (• ) were obtained in 1987, 
with Yearl. 2, and 3 scores obttod in 1988. 1989, and 1990. Pre-iest scores for the two-year cohort ( o ) were obtained in 1988, with Year I and Year 
2 scores obtained in 1989 and 1990. Mean number of contact insm»ctk>nal hours per year was 212.4 for the three-year cohort and 181 .6 for the two-year 
cohort. 
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